W3C home > Mailing lists > Public > www-jigsaw@w3.org > March to April 1999

Automated robots.txt

From: Roland Mainz <Roland.Mainz@informatik.med.uni-giessen.de>
Date: Mon, 26 Apr 1999 03:26:21 +0200
Message-Id: <3723C0BD.34C5737E@informatik.med.uni-giessen.de>
To: W3 Jigsaw Mailinglist <www-jigsaw@w3.org>

Hi !

----

I'd like to write an automated "robots.txt" resource for jigsaw
(robots.txt contains a list of files which should not be touched/read by
web robots
like search engines).

The idea is that this resource automatically walks througth jigsaw's
resource tree and
lists all CGIFrame and ServletFrame wrapped resources.

And now the question: How to "walk" through jigsaw'S resource tree ?

----

Bye,
Roland

--
  __ .  . __
 (o.\ \/ /.o)  Roland Mainz                               C programmer
  \__\/\/__/   Roland.Mainz@informatik.med.uni-giessen.de MPEG specialist
  /O /==\ O\   gisburn@w-specht.rhein-ruhr.de             Sun&&Amiga programmer
 (;O/ \/ \O;)  TEL +49 (0) 2426901568  FAX +49 (0) 2426901569
Received on Sunday, 25 April 1999 21:25:31 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 9 April 2012 12:13:29 GMT