W3C home > Mailing lists > Public > www-validator-cvs@w3.org > September 2004

[Bug 893] New: excessive robot.txt probes

From: <bugzilla@wiggum.w3.org>
Date: Mon, 27 Sep 2004 17:05:01 +0000
To: www-validator-cvs@w3.org
Message-Id: <E1CByvt-0008JC-EG@wiggum.w3.org>


           Summary: excessive robot.txt probes
           Product: CSSValidator
           Version: CSS Validator
          Platform: Sun
        OS/Version: Solaris
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Other
        AssignedTo: ot@w3.org
        ReportedBy: uldmjl@buffalo.edu
         QAContact: www-validator-cvs@w3.org - - [27/Sep/2004:11:45:30 -0400] "GET /robots.txt HTTP/1.1" 200 26

Why did your site probe the robots.txt file on my server
ublib.buffalo.edu 120 times this morning between 8:55 and 11:45?

It has been doing this since last week and it keeps on probing
whether or not the robots.txt file exists.

------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.
Received on Monday, 27 September 2004 17:05:02 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 23:02:07 UTC