W3C home > Mailing lists > Public > www-validator@w3.org > October 2013

Re: checklink:

From: David Dorward <david@dorward.me.uk>
Date: Wed, 02 Oct 2013 19:50:15 +0100
To: "Star Ostgard" <ostarella@gmail.com>
Cc: www-validator@w3.org
Message-ID: <5E85B102-2225-472B-B211-3BFDD5918DC2@dorward.me.uk>
On 2 Oct 2013, at 16:14, Star Ostgard wrote:

> Getting tons of 403 errors but links work fine

Picking one at random:

david@raston $ curl -I -A "W3C-checklink/4.81 libwww-perl/5.836" 
"http://www.fanfiction.net/s/8703579/1/Agony-of-Prodigals"
HTTP/1.1 403 Forbidden

( ~/ )——( 2013-10-02 07:47:47  )
david@raston $ curl -I 
"http://www.fanfiction.net/s/8703579/1/Agony-of-Prodigals"
HTTP/1.1 200 OK

The server is discriminating against the link checker (or, more likely, 
against libwww-perl, on the basis that "Some people use this open source 
tool to build things we don't like! Block everyone using this open 
source tool!" and the assumption that bad users of it won't change the 
user agent entirely).


-- 
David Dorward
http://dorward.co.uk/
Received on Wednesday, 2 October 2013 18:50:43 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 1 March 2016 14:18:09 UTC