Re: Think before you write Semantic Web crawlers

Le 23 juin 2011 à 04:36, Martin Hepp a écrit :
> There already exist respective blacklists and services, e.g.
> http://www.bot-trap.de/home/

Added to/Edited http://www.w3.org/wiki/Bad_Crawlers
And modified http://www.w3.org/wiki/Write_Web_Crawler

-- 
Karl Dubost - http://dev.opera.com/
Developer Relations & Tools, Opera Software

Received on Thursday, 23 June 2011 13:25:27 UTC