Link checker robot code - probably tonight from Ville Skyttä on 2004-04-07 (public-qa-dev@w3.org from April 2004)

From: Ville Skyttä <ville.skytta@iki.fi>
Date: Wed, 07 Apr 2004 17:29:07 +0300
To: QA Dev <public-qa-dev@w3.org>
Message-Id: <1081348147.14157.57.camel@bobcat.mine.nu>

I did not manage to commit the robots.txt stuff for checklink yesterday
because I ran into a couple of bugs in WWW::RobotRules and got
distracted fixing them.  I have an idea for a workaround, and will
hopefully get that and the rest of what I've done into a CVS near you
later tonight.

Received on Wednesday, 7 April 2004 10:29:09 UTC