W3C home > Mailing lists > Public > public-lod@w3.org > October 2010

Linked Data Spider Release

From: Andreas Harth <andreas@harth.org>
Date: Thu, 28 Oct 2010 11:31:48 +0200
Message-ID: <4CC94304.3000703@harth.org>
To: Linked Data community <public-lod@w3.org>
CC: Jürgen Umbrich <juergen.umbrich@deri.org>, 'Robert Isele' <robertisele@gmail.com>, "Hogan, Aidan" <aidan.hogan@deri.org>
We are happy to announce the release of LDSpider 1.1, an extensible Linked Data
crawling framework which enables client applications to traverse and to consume
the Web of Linked Data.  LDSpider provides an easy-to-use command line
interface as well as a Java API which allows applications to configure and
control the details of the crawling process.  LDSpider is multi-threaded
and can be used to collect small to medium-sized datasets up to tens of
millions of triples.

The project is a co-operation between Andreas Harth at AIFB and Juergen Umbrich
at DERI. Aidan Hogan (DERI) and Robert Isele (FU Berlin) are contributing.

LDSpider 1.1 introduces several features, including:
* Support for RDF/XML and Any23 to handle all kinds of input formats
including Turtle, Notation 3, RDFa and many microformats
* Crawled data can be written to a Triple Store using SPARQL/Update
* LDSpider can be configured to follow only ABox and/or TBox links, which
can be used to collect schema data together with the primary data.

More information about LDSpider 1.1 can be found at [1].

Best regards,

[1] http://code.google.com/p/ldspider/
Received on Thursday, 28 October 2010 09:32:20 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 7 January 2015 15:16:09 UTC