W3C home > Mailing lists > Public > semantic-web@w3.org > August 2014

Re: RDF Thrift : A binary format for RDF data

From: Michel Dumontier <michel.dumontier@gmail.com>
Date: Mon, 18 Aug 2014 10:06:31 -0700
Message-ID: <CALcEXf5GgtHhP9wFwmD7-LUJG532rU3ZrJpjT1Na620Dr8h0SA@mail.gmail.com>
To: Ruben Verborgh <ruben.verborgh@ugent.be>
Cc: Andy Seaborne <andy@seaborne.org>, SWIG Web <semantic-web@w3.org>
On Mon, Aug 18, 2014 at 2:16 AM, Ruben Verborgh <ruben.verborgh@ugent.be> wrote:
> Hi Andy,
>> How much is HDT used for real?
> We use it to enable client-side SPARQL query execution with 99.9% availability.
> Here is an online demo: http://client.linkeddatafragments.org/.
> The HDT files are used to run the server at http://data.linkeddatafragments.org/.
> Details on why HDT is a good format for this are here [1].
>> By whom?
> We (Ghent University – iMinds) use it to host high-availability queryable datasets.
> The software that enables this is available as open source [2],
> so anybody else can use it to do the same.
>> I couldn't find HDT files.
> For the same reason you won't find Virtuoso db files: we use it on the server.
actually, you can! The Bio2RDF project makes their indexed Virtuoso
dbs available.


we also provide gzipped nquads, and we'd be interested in providing an
alternative binary, indexed format.


> As you said, Thrift and HDT have different design goals.
> Thrift files are meant to be “found“, HDT files not necessarily.
> BTW you can find HDT files here: http://www.rdfhdt.org/datasets/
> And the tools to make them yourself: http://www.rdfhdt.org/download/
> Ruben
> PS I might be interested to look at a JavaScript/Node.js implementation of Thrift.
> Are there any plans (or code) in that direction already? Pointers to start?
> [1] http://linkeddatafragments.org/publications/iswc2014.pdf
> [2] https://github.com/LinkedDataFragments/
Received on Monday, 18 August 2014 17:07:19 UTC

This archive was generated by hypermail 2.4.0 : Tuesday, 5 July 2022 08:45:38 UTC