A proposal for handling bulk data requests

Kingsley, Gio, All,


An idea that arose out of a recent discussion with Juergen (in CC):  
how about providing a sort of 'bulk data request' facility for your  
SPARQL endpoints [1] [2] (as they are, I gather, the more popular ones  
on the WoD ;)?

It could work as follows:


1. Someone uploads a VoID description [3] of the targeted datasets and  
provides an email, Twitter, G+ handle or a WebID

2. You could generate the 'customized' dataset internally in a very  
efficient manner.

3. Once available, the requester is notified by means of the provided  
back-channel from 1.


I believe such a system in place would lower the crawling and bulk- 
query costs re bandwidth, etc. on your end, and opens up a business  
opportunity as well (think: WebID <-> Web Payments).


What do you think?

Cheers,
	Michael

[1] http://lod.openlinksw.com/sparql
[2] http://sparql.sindice.com/
[3] http://www.w3.org/TR/void/

--
Dr. Michael Hausenblas, Research Fellow
LiDRC - Linked Data Research Centre
DERI - Digital Enterprise Research Institute
NUIG - National University of Ireland, Galway
Ireland, Europe
Tel. +353 91 495730
http://linkeddata.deri.ie/
http://sw-app.org/about.html

Received on Monday, 11 July 2011 10:40:00 UTC