remote-blackbox: Do not follow HTTP redirects
There are a couple of websites we scrape that simply redirect to another name (e.g. _pyrocufflink.net_ → _dustin.hatch.name_, _tabitha.biz_ → _hatchlearningcenter.org_). For these, we want to track the availability of the first step, not the last, especially with regard to their certificate lifetimes.unifi-restore
parent
0e15c6a635
commit
423f28ea53
|
@ -6,6 +6,15 @@ blackbox_modules:
|
||||||
Accept-Charset: utf-8
|
Accept-Charset: utf-8
|
||||||
Accept-Language: en-US
|
Accept-Language: en-US
|
||||||
method: GET
|
method: GET
|
||||||
|
follow_redirects: false
|
||||||
|
valid_status_codes:
|
||||||
|
- 200
|
||||||
|
- 301
|
||||||
|
- 302
|
||||||
|
- 303
|
||||||
|
- 304
|
||||||
|
- 307
|
||||||
|
- 308
|
||||||
prober: http
|
prober: http
|
||||||
timeout: 5s
|
timeout: 5s
|
||||||
|
|
||||||
|
|
Loading…
Reference in New Issue