Automated robots.txt

Search in the source code, I know I had written such a think along
time ago, it was difficult. Obviously if you find it, you'll have tom
ake whatever changes are needed to have run in the new stuff (>
2.0). BTW This may be in some of the old upgfrade packages...

Anselm.

Roland Mainz writes:
 > 
 > Hi !
 > 
 > ----
 > 
 > I'd like to write an automated "robots.txt" resource for jigsaw
 > (robots.txt contains a list of files which should not be touched/read by
 > web robots
 > like search engines).
 > 
 > The idea is that this resource automatically walks througth jigsaw's
 > resource tree and
 > lists all CGIFrame and ServletFrame wrapped resources.
 > 
 > And now the question: How to "walk" through jigsaw'S resource tree ?
 > 
 > ----
 > 
 > Bye,
 > Roland
 > 
 > --
 >   __ .  . __
 >  (o.\ \/ /.o)  Roland Mainz                               C programmer
 >   \__\/\/__/   Roland.Mainz@informatik.med.uni-giessen.de MPEG specialist
 >   /O /==\ O\   gisburn@w-specht.rhein-ruhr.de             Sun&&Amiga programmer
 >  (;O/ \/ \O;)  TEL +49 (0) 2426901568  FAX +49 (0) 2426901569
 > 
 > 
 > 
 > 
 > 

Received on Monday, 3 May 1999 12:41:54 UTC