W3C home > Mailing lists > Public > public-xg-webid@w3.org > June 2011

Re: Crawlers and WebID

From: Henry Story <henry.story@bblfish.net>
Date: Fri, 24 Jun 2011 10:32:42 +0200
Cc: foaf-protocols@lists.foaf-project.org
Message-Id: <EAA5B981-E619-41DF-8ECD-EFFD3ED20A97@bblfish.net>
To: WebID XG <public-xg-webid@w3.org>

On 23 Jun 2011, at 23:58, Henry Story wrote:

> Richard  Cyganiak kindly moved the part I wrote up to its own space
> 
>   http://www.w3.org/wiki/WebID_and_Crawler

Oops, that should have been 

  http://www.w3.org/wiki/WebID_and_Crawlers



> 
> after reformatting the text.
> 
> 	Henry
> 
> On 23 Jun 2011, at 18:50, Henry Story wrote:
> 
>> There was a very long discussion on the Linked Data mailing list on issues of student build crawlers going crazy on linked data sites, in such a way that it amounted to a denial of service attacks.
>> 
>> The thread is entitled "Think before you write Semantic Web crawlers"
>> 
>>  http://lists.w3.org/Archives/Public/public-lod/2011Jun/0499.html
>> 
>> Kingsley and I have been very vocal in urging for WebID enabled crawlers and linked data publishers to solve this problem. I think we even got some good mind share on it.
>> 
>> I wrote up the details here:
>> 
>> http://www.w3.org/wiki/Bad_Crawlers
>> 
>> We could use this as a powerful use case for WebID. Please add improvements on that page, and we should link to it somewhere.
>> 
>> Henry
>> 
>> 
>> 
>> Social Web Architect
>> http://bblfish.net/
>> 
> 
> Social Web Architect
> http://bblfish.net/
> 

Social Web Architect
http://bblfish.net/
Received on Friday, 24 June 2011 08:33:13 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 21:06:24 UTC