We don't want your robot to visit our site. We don't use your service, and we don't particularly like the idea of other people using your robot to scan our site. There is a standard for robot exclusion. Your robot doesn't follow it. It should. All we can do at this time is use Apache rules to shovel garbage into it when it visits. It would save everyone a lot of trouble if it honored the standard robots.txt. __________________________________________________ Do you Yahoo!? Yahoo! Mail Plus - Powerful. Affordable. Sign up now. http://mailplus.yahoo.comReceived on Sunday, 22 December 2002 00:41:58 GMT
This archive was generated by hypermail 2.2.0+W3C-0.50 : Wednesday, 25 April 2012 12:14:05 GMT