Re: checklink:

On 2 Oct 2013, at 16:14, Star Ostgard wrote:

> Getting tons of 403 errors but links work fine

Picking one at random:

david@raston $ curl -I -A "W3C-checklink/4.81 libwww-perl/5.836" 
"http://www.fanfiction.net/s/8703579/1/Agony-of-Prodigals"
HTTP/1.1 403 Forbidden

( ~/ )——( 2013-10-02 07:47:47  )
david@raston $ curl -I 
"http://www.fanfiction.net/s/8703579/1/Agony-of-Prodigals"
HTTP/1.1 200 OK

The server is discriminating against the link checker (or, more likely, 
against libwww-perl, on the basis that "Some people use this open source 
tool to build things we don't like! Block everyone using this open 
source tool!" and the assumption that bad users of it won't change the 
user agent entirely).


-- 
David Dorward
http://dorward.co.uk/

Received on Wednesday, 2 October 2013 18:50:43 UTC