[Bug 4985] Link checker dies on links to particular url

http://www.w3.org/Bugs/Public/show_bug.cgi?id=4985


Ville Skyttä <ville.skytta@iki.fi> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |ASSIGNED




--- Comment #4 from Ville Skyttä <ville.skytta@iki.fi>  2009-03-04 17:26:07 ---
I guess the reason for the first one taking double time is that under the hood,
when accessing a host for the first time, link checker (LWP::RobotUA) tries to
fetch /robots.txt which times out after 20 sec, then accessing the actual
resource takes another 20.  Subsequent resources on the same host during the
same check no longer result in /robots.txt access.

I agree with lowering the default timeout, it's 30 seconds in CVS now.


-- 
Configure bugmail: http://www.w3.org/Bugs/Public/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.

Received on Wednesday, 4 March 2009 17:26:21 UTC