Re: Draft text for asking for implementation reports

On Feb 8, 2012, at 4:54 PM, Andy Seaborne wrote:

> This is based on Lee's message from last time.
> 
> 1/ It refers to
>   http://www.w3.org/2001/sw/DataAccess/tests/earl
> for the test result format.
> 
> Is that still current?

There's a typo: "earl;assertedBy"

I wonder if we should recommend using the new earl:passed/failed instead of the old earl:pass/fail IRIs. I think I've updated my code to handle both forms, but haven't actually tested it yet.

I'd also like to add text to request that earl submissions include DOAP data for at least the name and homepage of the implementation.

> 2/ Looking at the summary
> 
> http://www.w3.org/2009/sparql/docs/tests/summary.html
> 
> dated Nov 2011 - is this current?

The date is correct: the page doesn't reflect recent changes to the test suite. Another script in my implementations report repo generates that page, and I can rerun it to produce an updated version.

> 3/ License
> 
> Greg - can I encourage you to put a LICENSE file in the project
> 
> https://github.com/kasei/SPARQL-1.1-Implementation-Report
> 
> and a copyright/licnese hearder on SPARQLReport.pm ?

Sure. Do you have a preference on license? Does the W3C? I have none.

> ---------------------
> SPARQL-WG is finalizing the test suite for SPARQL 1.1  The group's hope is that the test suite will serve multiple purposes:
> 
> + Provide a basis for testing new and existing SPARQL implementations to promote interoperability
> + Aid implementers in determining the expected behaviour of various constructs in the language
> 
> SPARQL-WG will also use reports as the basis for generating an implementation report for SPARQL.
> 
> We ask implementers to attempt to run the test suite and report results to the working group.
> 
> Materials::
> 
> A README describes the vocabularies used to describe and structure of the SPARQL 1.1 tests in manifest files:
> 
> http://www.w3.org/2009/sparql/docs/tests/README.html
> 
> This is an incremental update on the test framework used for SPARQL 1.0, adding testing mechanism for update, entailment and federated query.

As well as format tests for JSON and CSV/TSV.

Otherwise, this looks good to me.

.greg

Received on Wednesday, 8 February 2012 23:12:20 UTC