Patrick.Stickler@nokia.com wrote: > > .... > A specific question to help me determine that: If the server owner > says "no crawlers at all on this server" and a tenant says "all my > own content can be crawled", should the tenant's content be crawled? The server owner runs the HTTP server. No data can go in or out of the system without their explicit or implicit agreement. In particular, they can trivially block the MGET method or metadata header or whatever emerges in their Apache configuration. Paul PrescodReceived on Tuesday, 18 February 2003 20:26:05 GMT
This archive was generated by hypermail 2.2.0+W3C-0.50 : Friday, 12 September 2008 07:01:57 GMT