W3C home > Mailing lists > Public > www-jigsaw@w3.org > May to June 1999

Automated robots.txt

From: Anselm Baird-Smith <anselmb@eng.sun.com>
Date: Mon, 3 May 1999 09:38:32 -0700 (PDT)
To: Roland Mainz <Roland.Mainz@informatik.med.uni-giessen.de>
Cc: W3 Jigsaw Mailinglist <www-jigsaw@w3.org>
Message-ID: <14125.53451.348729.99971@gaston>

Search in the source code, I know I had written such a think along
time ago, it was difficult. Obviously if you find it, you'll have tom
ake whatever changes are needed to have run in the new stuff (>
2.0). BTW This may be in some of the old upgfrade packages...

Anselm.

Roland Mainz writes:
 > 
 > Hi !
 > 
 > ----
 > 
 > I'd like to write an automated "robots.txt" resource for jigsaw
 > (robots.txt contains a list of files which should not be touched/read by
 > web robots
 > like search engines).
 > 
 > The idea is that this resource automatically walks througth jigsaw's
 > resource tree and
 > lists all CGIFrame and ServletFrame wrapped resources.
 > 
 > And now the question: How to "walk" through jigsaw'S resource tree ?
 > 
 > ----
 > 
 > Bye,
 > Roland
 > 
 > --
 >   __ .  . __
 >  (o.\ \/ /.o)  Roland Mainz                               C programmer
 >   \__\/\/__/   Roland.Mainz@informatik.med.uni-giessen.de MPEG specialist
 >   /O /==\ O\   gisburn@w-specht.rhein-ruhr.de             Sun&&Amiga programmer
 >  (;O/ \/ \O;)  TEL +49 (0) 2426901568  FAX +49 (0) 2426901569
 > 
 > 
 > 
 > 
 > 
Received on Monday, 3 May 1999 12:41:54 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 9 April 2012 12:13:29 GMT