- From: <bugzilla@wiggum.w3.org>
- Date: Mon, 27 Sep 2004 17:05:01 +0000
- To: www-validator-cvs@w3.org
http://www.w3.org/Bugs/Public/show_bug.cgi?id=893
Summary: excessive robot.txt probes
Product: CSSValidator
Version: CSS Validator
Platform: Sun
OS/Version: Solaris
Status: NEW
Severity: normal
Priority: P2
Component: Other
AssignedTo: ot@w3.org
ReportedBy: uldmjl@buffalo.edu
QAContact: www-validator-cvs@w3.org
128.30.52.13 - - [27/Sep/2004:11:45:30 -0400] "GET /robots.txt HTTP/1.1" 200 26
Why did your site probe the robots.txt file on my server
ublib.buffalo.edu 120 times this morning between 8:55 and 11:45?
It has been doing this since last week and it keeps on probing
whether or not the robots.txt file exists.
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.
Received on Monday, 27 September 2004 17:05:02 UTC