W3C home > Mailing lists > Public > www-validator@w3.org > December 2002

Re: Unwanted robot accesses from your site

From: Michæl Rolfe <mumble@mweb.co.za>
Date: Sun, 22 Dec 2002 15:37:28 +0200
Message-ID: <019901c2a9bf$5aa67020$2dcafea9@mumble>
To: <www-validator@w3.org>
You know, now that I've calmed down a bit after reading the subject line of this e-mail, I think this would be a good juncture to suggest tweaking this list's configuration so that the text "[www-validator]", say, got prepended to the subject line of each post.

  ----- Original Message ----- 
  From: miim webmaster 
  To: www-validator@w3.org 
  Sent: Sunday, December 22, 2002 7:39 AM
  Subject: Unwanted robot accesses from your site




  We don't want your robot to visit our site.

  We don't use your service, and we don't particularly
  like the idea of other people using your robot to
  scan our site.

  There is a standard for robot exclusion.  Your robot
  doesn't follow it.  It should.  All we can do at this
  time is use Apache rules to shovel garbage into it
  when it visits.  It would save everyone a lot of
  trouble if it honored the standard robots.txt.



  __________________________________________________
  Do you Yahoo!?
  Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
  http://mailplus.yahoo.com
Received on Sunday, 22 December 2002 09:22:19 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Wednesday, 25 April 2012 12:14:05 GMT