- From: miim webmaster <xxdpplus@yahoo.com>
- Date: Sat, 21 Dec 2002 21:39:51 -0800 (PST)
- To: www-validator@w3.org
We don't want your robot to visit our site. We don't use your service, and we don't particularly like the idea of other people using your robot to scan our site. There is a standard for robot exclusion. Your robot doesn't follow it. It should. All we can do at this time is use Apache rules to shovel garbage into it when it visits. It would save everyone a lot of trouble if it honored the standard robots.txt. __________________________________________________ Do you Yahoo!? Yahoo! Mail Plus - Powerful. Affordable. Sign up now. http://mailplus.yahoo.com
Received on Sunday, 22 December 2002 00:41:58 UTC