Re: Making Linkchecker working parallel

On 31 Aug 2005, at 22:02, Dominique Hazaël-Massieux wrote:
> Le mercredi 31 août 2005 à 19:06 +0900, olivier Thereaux a écrit :
>> What we have in CVS now is an (almost) functional solution based on
>> wait(). Except that this doesn't work in the case of a 401.
>
> Actually, I got version 4.23 to work with the simple document  
> attached.
> [...]
> Or to fix the bug in LWP::Parallel if we can identify it, no?

Hmm, thanks.

Some printf debugging (  print $response->as_string;) leads me to  
think the issue was not 401s but cases of 403 (Forbidden) Forbidden  
by robots.txt
... so the bug may be with LWP::Parallel::RobotUA or LWP::RobotUA  
upstream.

test doc attached.
-- 
olivier

Received on Friday, 2 September 2005 09:59:10 UTC