Call for Systems: Mighty Storage Challenge @ ESWC 2017

Mighty Storage Challenge: Call for Systems
In conjunction with ESWC 2017
May 28 - June 2 2017 Portoroz, Slovenia
Website and training data: 
https://project-hobbit.eu/challenges/mighty-storage-challenge/


1 Aim
The aim of the mighty storage challenge is to test the performance of 
solutions for SPARQL processing in aspects that are relevant for modern 
applications. These include ingesting data, answering queries on large 
datasets and serving as backend for applications driven by Linked Data. 
The proposed challenge will test the systems against data derived from 
real applications and with realistic loads. An emphasis will be put on 
dealing with changing data in form of streams or updates. This challenge 
will comprise the following tasks: (1) RDF data ingestion, (2) data 
storage, (3) versioning and (4) browsing.

In essence:
* Task 1 will measure how well systems can ingest streams of RDF data.
* Task 2 will measure how data stores perform with different types of 
queries.
* Task 3 will measure how well versioning and archiving systems for 
Linked Data perform when they store multiple versions of large data sets.
* Task 4 will check existing solutions for how well they support 
applications that need browsing through large data sets.


We herewith invite system developers to participate in the 
aforementioned tasks. The system developers are invited to write papers 
presenting their results on the training data (see important dates 
below). To ensure that the system results are comparable, we will 
provide the HOBBIT benchmarking platform for the generation of the final 
results to be included into the system publications. A specification of 
the hardware on which the benchmarks will be ran will be released in due 
course.
2 Prerequisites for Participation
Each participant must:
* provide a storage system that processes INSERT SPARQL queries
* provide a storage solution that can process SPARQL SELECT queries
* provide his/her solution as a docker image that abides by the technical
* specifications which will be released with the challenge
3 Prizes
The overall winner of the challenge will get a prize of at least 500€. 
Further prizes are being organized.


4 Important Dates


Release of training data and instructions:    January 13th, 2017
Paper submission deadline:                    March 10th, 2017
Challenge paper reviews:                      April 5th, 2017
Paper Notifications and invitation to task:   April 7th, 2017
Beginning of benchmarking runs on platform:   April 7th, 2017
Camera ready papers (5 pages document):       April 23rd, 2017
Release of evaluation results:                June 2nd, 2017
Camera-ready challenge proceedings version:   June 30th, 2017 (tentative)
Proclamation of winners:                      June 2nd, 2017 (ESWC 2017)

Received on Monday, 16 January 2017 15:16:21 UTC