- From: Andreas Harth <andreas@harth.org>
- Date: Thu, 28 Oct 2010 11:31:48 +0200
- To: Linked Data community <public-lod@w3.org>
- CC: Jürgen Umbrich <juergen.umbrich@deri.org>, 'Robert Isele' <robertisele@gmail.com>, "Hogan, Aidan" <aidan.hogan@deri.org>
We are happy to announce the release of LDSpider 1.1, an extensible Linked Data crawling framework which enables client applications to traverse and to consume the Web of Linked Data. LDSpider provides an easy-to-use command line interface as well as a Java API which allows applications to configure and control the details of the crawling process. LDSpider is multi-threaded and can be used to collect small to medium-sized datasets up to tens of millions of triples. The project is a co-operation between Andreas Harth at AIFB and Juergen Umbrich at DERI. Aidan Hogan (DERI) and Robert Isele (FU Berlin) are contributing. LDSpider 1.1 introduces several features, including: * Support for RDF/XML and Any23 to handle all kinds of input formats including Turtle, Notation 3, RDFa and many microformats * Crawled data can be written to a Triple Store using SPARQL/Update * LDSpider can be configured to follow only ABox and/or TBox links, which can be used to collect schema data together with the primary data. More information about LDSpider 1.1 can be found at [1]. Best regards, Andreas. [1] http://code.google.com/p/ldspider/
Received on Thursday, 28 October 2010 09:32:20 UTC