Re: A proposal for handling bulk data requests

Similar to what facebook does when you ask for a dump of your data. It takes
hours/days, but then they eventually send you a URI and you can download a
zip file (full of html pages)


Juan Sequeda
+1-575-SEQ-UEDA
www.juansequeda.com


On Mon, Jul 11, 2011 at 12:39 PM, Michael Hausenblas <
michael.hausenblas@deri.org> wrote:

>
> Kingsley, Gio, All,
>
>
> An idea that arose out of a recent discussion with Juergen (in CC): how
> about providing a sort of 'bulk data request' facility for your SPARQL
> endpoints [1] [2] (as they are, I gather, the more popular ones on the WoD
> ;)?
>
> It could work as follows:
>
>
> 1. Someone uploads a VoID description [3] of the targeted datasets and
> provides an email, Twitter, G+ handle or a WebID
>
> 2. You could generate the 'customized' dataset internally in a very
> efficient manner.
>
> 3. Once available, the requester is notified by means of the provided
> back-channel from 1.
>
>
> I believe such a system in place would lower the crawling and bulk-query
> costs re bandwidth, etc. on your end, and opens up a business opportunity as
> well (think: WebID <-> Web Payments).
>
>
> What do you think?
>
> Cheers,
>        Michael
>
> [1] http://lod.openlinksw.com/**sparql <http://lod.openlinksw.com/sparql>
> [2] http://sparql.sindice.com/
> [3] http://www.w3.org/TR/void/
>
> --
> Dr. Michael Hausenblas, Research Fellow
> LiDRC - Linked Data Research Centre
> DERI - Digital Enterprise Research Institute
> NUIG - National University of Ireland, Galway
> Ireland, Europe
> Tel. +353 91 495730
> http://linkeddata.deri.ie/
> http://sw-app.org/about.html
>
>
>

Received on Thursday, 14 July 2011 17:17:40 UTC