W3C home > Mailing lists > Public > public-lod@w3.org > June 2011

Re: Think before you write Semantic Web crawlers

From: Kingsley Idehen <kidehen@openlinksw.com>
Date: Wed, 22 Jun 2011 15:29:28 +0100
Message-ID: <4E01FC48.1010701@openlinksw.com>
To: public-lod@w3.org
On 6/22/11 3:00 PM, Dieter Fensel wrote:
> At 14:37 22.06.2011, Andreas Harth wrote:
>> Hi Martin,
>>
>> first let me say that I do think crawlers should follow basic politeness
>> rules (contact info in User-Agent, adhere to the Robot Exclusion 
>> Protocol).
>>
>> However, I am delighted that people actually start consuming Linked 
>> Data,
>> and we should encourage that.
>
> The real challenge may be to achieve usage of data in a way that 
> provide benefits to its provider.
>
>

Closer, but the core algorithm or heuristic will always require 
something like WebID plus some serious Linked Data dog-fooding re. trust 
logics. Ooooowl ! :-)


-- 

Regards,

Kingsley Idehen	
President&  CEO
OpenLink Software
Web: http://www.openlinksw.com
Weblog: http://www.openlinksw.com/blog/~kidehen
Twitter/Identi.ca: kidehen
Received on Wednesday, 22 June 2011 14:29:52 UTC

This archive was generated by hypermail 2.4.0 : Thursday, 24 March 2022 20:29:54 UTC