W3C home > Mailing lists > Public > public-lod@w3.org > June 2010

Re: Please stop massive crawling against http://openean.kaufkauf.net/id/

From: Robert Fuller <robert.fuller@deri.org>
Date: Tue, 08 Jun 2010 14:59:15 +0100
Message-ID: <4C0E4CB3.9010909@deri.org>
To: Kingsley Idehen <kidehen@openlinksw.com>
CC: public-lod@w3.org
Kingsley Idehen wrote:

> The LOD Cloud Cache at DERI is a live Virtuoso instance with 15 Billion+ 
> Triples loaded. It covers as much of the LOD Cloud as we've be able to 
> get our hands on plus 6.4 Billion Triples from the Data.Gov effort.
> 
> I'll drop a more detailed note about this instance (via blog post) once 
> we are done with data loading (there's a massive collection of eCommerce 
> oriented Products & Services data to be loaded amongst others).

I wonder is this data load the culprit responsible for the "massive 
crawling"?

-- 
Robert Fuller
Research Associate
Sindice Team
DERI, Galway
http://sindice.com/
Received on Tuesday, 8 June 2010 15:04:43 UTC

This archive was generated by hypermail 2.3.1 : Sunday, 31 March 2013 14:24:27 UTC