Re: ANN: WebDataCommons.org - Offering 3.2 billion quads current RDFa, Microdata and Miroformat data extracted from 65.4 million websites from Dan Brickley on 2012-04-17 (public-lod@w3.org from April 2012)

From: Dan Brickley <danbri@danbri.org>
Date: Tue, 17 Apr 2012 21:23:41 +0200
To: Martin Hepp <martin.hepp@ebusiness-unibw.org>, Chris Bizer <chris@bizer.de>
Cc: Peter Mika <pmika@yahoo-inc.com>, "public-vocabs@w3.org Vocabularies" <public-vocabs@w3.org>, public-lod@w3.org
Message-ID: <CAFfrAFo9Sp-QmD1xZ6yonisumpGfF0Hf_WPhM+WztO1yCmEV9Q@mail.gmail.com>

How about adding a disclaimer line to the webdatacommons.org site like

"Note that the many database-backed sites contain a huge long tail of
rarely-visited, rarely-linked pages (e.g. product catalogues), but
which increasingly contain useful structured data. It is best not to
assume that this collection contains a complete, deep crawl of every
site it touches."

Dan

Received on Tuesday, 17 April 2012 19:24:13 UTC