Soliciting test suite results for SPARQL query language implementations

The DAWG has decided[1] that the current set of approved tests 
constitute a reasonable test suite for the SPARQL query language.

The group's hope is that the test suite will serve multiple purposes:

+ Provide a basis for testing new and existing SPARQL implementations to 
promote interoperability
+ Aid implementors in determining the expected behavior of various 
constructs in the language

The DAWG will also use implementations' results of running the test 
suite as the basis for generating an implementation report for SPARQL, 
one of the group's exit criteria[2] for advancing the specification to 
Proposed Recommendation status.

It is with that in mind that we ask implementations to attempt to run 
the test suite and report results to the working group. The DAWG is 
aiming to generate an implementation report by September 18, so we ask 
that test results be submitted by then if at all possible.

Here's the relevant information:

A README describes the vocabularies used to describe and structure the
DAWG tests in manifest files:
   http://www.w3.org/2001/sw/DataAccess/tests/README.html

An overview page provides a human-readable description of the approved
tests, as well as links to archives of the collected test materials for 
download:
   http://www.w3.org/2001/sw/DataAccess/tests/r2

We also have a document showing how to use the EARL vocabulary to report
results of running tests against your implementation. (EARL is an RDF
schema for reporting test results produced by the W3C Evaluation and
Repair Tools working group.)
   http://www.w3.org/2001/sw/DataAccess/tests/earl

While we'd appreciate it if implementors could report results in this 
EARL format, we'd be glad to receive implementation reports in other 
formats as well.

Please direct questions about the test suite to this mailing list. Test 
results can be sent to the list as well or else directly to me (but
please indicate that the Working Group can use your results).

thanks,
Lee

[1] 
http://lists.w3.org/Archives/Public/public-rdf-dawg/2007JulSep/att-0096/21-dawg-minutes.html#item05
[2] http://www.w3.org/TR/rdf-sparql-query/

Received on Tuesday, 21 August 2007 20:04:33 UTC