W3C home > Mailing lists > Public > public-xg-webid@w3.org > June 2011

Crawlers and WebID

From: Henry Story <henry.story@bblfish.net>
Date: Thu, 23 Jun 2011 18:50:13 +0200
Message-Id: <407863B3-C4C2-49B6-82AB-12448781D303@bblfish.net>
Cc: foaf-protocols@lists.foaf-project.org
To: WebID XG <public-xg-webid@w3.org>
There was a very long discussion on the Linked Data mailing list on issues of student build crawlers going crazy on linked data sites, in such a way that it amounted to a denial of service attacks.

The thread is entitled "Think before you write Semantic Web crawlers"


Kingsley and I have been very vocal in urging for WebID enabled crawlers and linked data publishers to solve this problem. I think we even got some good mind share on it.

I wrote up the details here:


We could use this as a powerful use case for WebID. Please add improvements on that page, and we should link to it somewhere.



Social Web Architect
Received on Thursday, 23 June 2011 16:50:44 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 19:39:45 UTC