W3C home > Mailing lists > Public > public-lod@w3.org > July 2011

A proposal for handling bulk data requests

From: Michael Hausenblas <michael.hausenblas@deri.org>
Date: Mon, 11 Jul 2011 11:39:20 +0100
Message-Id: <447960F6-814E-4FBA-86C9-044E93E1D1AA@deri.org>
To: Kingsley Idehen <kidehen@openlinksw.com>, Giovanni Tummarello <giovanni.tummarello@deri.org>
Cc: Linked Data community <public-lod@w3.org>, Jürgen Umbrich <juergen.umbrich@deri.org>

Kingsley, Gio, All,

An idea that arose out of a recent discussion with Juergen (in CC):  
how about providing a sort of 'bulk data request' facility for your  
SPARQL endpoints [1] [2] (as they are, I gather, the more popular ones  
on the WoD ;)?

It could work as follows:

1. Someone uploads a VoID description [3] of the targeted datasets and  
provides an email, Twitter, G+ handle or a WebID

2. You could generate the 'customized' dataset internally in a very  
efficient manner.

3. Once available, the requester is notified by means of the provided  
back-channel from 1.

I believe such a system in place would lower the crawling and bulk- 
query costs re bandwidth, etc. on your end, and opens up a business  
opportunity as well (think: WebID <-> Web Payments).

What do you think?


[1] http://lod.openlinksw.com/sparql
[2] http://sparql.sindice.com/
[3] http://www.w3.org/TR/void/

Dr. Michael Hausenblas, Research Fellow
LiDRC - Linked Data Research Centre
DERI - Digital Enterprise Research Institute
NUIG - National University of Ireland, Galway
Ireland, Europe
Tel. +353 91 495730
Received on Monday, 11 July 2011 10:40:00 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 7 January 2015 15:16:15 UTC