W3C home > Mailing lists > Public > www-lib@w3.org > July to September 1999

Re: Robot crash

From: Guy Ferran <guy.ferran@ardentsoftware.fr>
Date: Thu, 29 Jul 1999 19:18:32 +0200
Message-ID: <37A08CE8.81EBB301@ardentsoftware.fr>
To: John Punin <puninj@cs.rpi.edu>
CC: www-lib@w3.org
Hi John,

Here is the command line I am using:


run -vu -q -ss -n -depth 99 \
-exclude
'/ArchiveBrowser/|/History/|/member/|/team/|\.gz$|\.tar$|\.tgz$|\.Z$|\.zip$|\.ZIP$|\.exe$|\.EXE$|\.ps$|\.doc$|\.pdf$|\.xplot$|\.java$|\.c$|\.h$|\.ppt$|\.gif$|\.GIF$|\.tiff$|\.png$|\.PNG$|\.jpeg$|\.jpg$|\.JPE$'
\
-prefix http:// \
-l robot2-log-clf.txt \
-alt robot2-log-alt.txt \
-hit robot2-log-hit.txt \
-rellog robot2-log-link-relations.txt -relation stylesheet \
-lm robot2-log-lastmodified.txt \
-title robot2-log-title.txt \
-referer robot2-log-referer.txt \
-negotiated robot2-log-negotiated.txt \
-404 robot2-log-notfound.txt \
-reject robot2-log-reject.txt \
-format robot2-log-format.txt \
-charset robot2-log-charset.txt  \
-cache \
-timeout 60 \
http://www.xmltree.com


-- 
Guy Ferran
e-mail: guy.ferran@ardentsoftware.fr
tel: (33) 01 30 84 77 77
fax: (33) 01 30 84 77 90
Received on Thursday, 29 July 1999 13:18:12 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 5 February 2014 07:15:17 UTC