- From: Shantz <michaelshantz@attbi.com>
- Date: Wed, 23 Oct 2002 12:35:33 -0400 (EDT)
- To: <www-jigsaw@w3.org>
I've been using jigsaw to serve a webpage for a while. When looking at the log, I often see what appears to be webcrawlers doing a GET on robots.txt. I have never had such a file. Does anyone know what this is about? Mike
Received on Thursday, 24 October 2002 04:57:21 UTC