W3C home > Mailing lists > Public > semantic-web@w3.org > August 2014

Re: RDF Thrift : A binary format for RDF data

From: Ruben Verborgh <ruben.verborgh@ugent.be>
Date: Mon, 18 Aug 2014 11:16:21 +0200
Cc: semantic-web@w3.org
Message-Id: <DB011B38-F718-4BD1-9889-CDCBC6420BE7@ugent.be>
To: Andy Seaborne <andy@seaborne.org>
Hi Andy,

> How much is HDT used for real?

We use it to enable client-side SPARQL query execution with 99.9% availability.
Here is an online demo: http://client.linkeddatafragments.org/.

The HDT files are used to run the server at http://data.linkeddatafragments.org/.
Details on why HDT is a good format for this are here [1].

> By whom?

We (Ghent University – iMinds) use it to host high-availability queryable datasets.
The software that enables this is available as open source [2],
so anybody else can use it to do the same.

> I couldn't find HDT files.

For the same reason you won't find Virtuoso db files: we use it on the server.
As you said, Thrift and HDT have different design goals.
Thrift files are meant to be “found“, HDT files not necessarily.

BTW you can find HDT files here: http://www.rdfhdt.org/datasets/
And the tools to make them yourself: http://www.rdfhdt.org/download/

Ruben

PS I might be interested to look at a JavaScript/Node.js implementation of Thrift.
Are there any plans (or code) in that direction already? Pointers to start?

[1] http://linkeddatafragments.org/publications/iswc2014.pdf
[2] https://github.com/LinkedDataFragments/
Received on Monday, 18 August 2014 09:16:54 UTC

This archive was generated by hypermail 2.4.0 : Tuesday, 5 July 2022 08:45:38 UTC