Re: New response code

At 09:43 am 2/19/96 +0100, Mirsad Todorovac spake:
>> It would be really nice if there were a response code (say, 405) for
>> "robot forbidden that URL."  Technically, "forbidden" is already covered
>> through 403, but it would still be nice to have something more
>> descriptive.

   There is already a method of dealing with this that takes much 
less traffic than responing on a url-by-url basis. 

   The "robots.txt" file is described at:

| BearHeart / Bill Weinman | | 
| Author of The CGI Book -- 

Received on Monday, 19 February 1996 05:32:01 UTC