W3C home > Mailing lists > Public > public-wai-ert@w3.org > January 2007

experience generating EARL for GRDDL test results

From: Dan Connolly <connolly@w3.org>
Date: Fri, 12 Jan 2007 23:56:15 +0000
To: public-wai-ert@w3.org
Cc: Sean Palmer <sean@miscoranda.com>, public-grddl-comments@w3.org, public-sparql-dev@w3.org
Message-Id: <1168646166.22375.28.camel@dirk>
The GRDDL WG is working on a test suite
  http://www.w3.org/2001/sw/grddl-wg/td/testlist1

I'm interested to have test results from various
implementations aggregated, the way Sandro did for
the OWL tests.
http://www.w3.org/QA/2006/11/celebrating_owl_interoperabili.html

So I updated our test harness so that it produces EARL; for
each test, you get something like:

      [      a :Assertion;
             :assertedBy dan:dwc;
             :test tes:sq1a;
             :testResult  [
                 a :TestResult;
                 :validity :pass ];
             :testSubject p:grddl_py ].

This is based on a clue I got from Sean
  http://chatlogs.planetrdf.com/swig/2006-11-10.html#T15-13-57
and not from a careful reading of the EARL docs. Let me
know if it's not right.

The full output is attached, in RDF/XML as generated
by the tool and converted to .n3.

Do you have any tools to make nice HTML reports out of EARL data?

As to dan:dwc and p:grddl_py, I wrote a little documentation
about this use of EARL, FOAF, and DOAP:

[[
EARL tester and subject

In addition to various diagnostics on stderr, the test harness writes to
stdout some RDF data: an EARL assertion about each test it runs.

To tell it about the person running the tests and the software project
being tested, point it at an ID in a foaf file and a DOAP file:

$ python testft.py \
  --tester 'dan.rdf#dwc' \
  --project 'grddlft.rdf#grddl_py' \
  --run your_grddl_impl \
  testlist1.rdf >earl_out.rdf
 All tests were passed!
]]
 -- http://www.w3.org/2001/sw/grddl-wg/td/testlist1#earl_out

While adding EARL support to the test harness
  http://www.w3.org/2001/sw/grddl-wg/td/testft.py
I couldn't figure out how to get an RDF/RDFS representation
of the schema document...

 http://www.w3.org/WAI/ER/EARL/nmg-strawman

Am I doing something wrong?

$ curl -I -H 'Accept: application/rdf+xml' http://www.w3.org/WAI/ER/EARL/nmg-strawman

HTTP/1.1 302 Found
Date: Fri, 12 Jan 2007 23:54:04 GMT
Server: Apache/1.3.37 (Unix) PHP/4.4.4
Location: http://www.w3.org/WAI/ER/EARL10/WD-EARL10-Schema-20060919

But at that location, I get HTML.

-- 
Dan Connolly, W3C http://www.w3.org/People/Connolly/
D3C2 887B 0F92 6005 C541  0875 0F91 96DE 6E52 C29E

#Processed by Id: cwm.py,v 1.190 2006/08/09 23:20:42 syosi Exp 
        #    using base file:///home/connolly/w3ccvs/WWW/2001/sw/grddl-wg/td/,earl.rdf
        
#  Notation3 generation by
#       notation3.py,v 1.191 2006/08/01 01:14:04 syosi Exp

#   Base was: file:///home/connolly/w3ccvs/WWW/2001/sw/grddl-wg/td/,earl.rdf
     @prefix : <http://www.w3.org/WAI/ER/EARL/nmg-strawman#> .
    @prefix dan: <dan.rdf#> .
    @prefix doap: <http://usefulinc.com/ns/doap#> .
    @prefix p: <../grddlft/project.rdf#> .
    @prefix tes: <testlist1.rdf#> .
    
    p:grddl_py     a doap:Project;
         doap:created "2007-01-12";
         doap:homepage <http://www.w3.org/2001/sw/grddl-wg/g>;
         doap:license <http://www.w3.org/Consortium/Legal/2002/copyright-software-20021231>;
         doap:mailing-list <http://lists.w3.org/Archives/Public/public-grddl-comments/>;
         doap:maintainer dan:dwc,
                 [
             a <http://xmlns.com/foaf/0.1/Person>;
             <http://xmlns.com/foaf/0.1/mbox> <mailto:ogbujic@ccf.org>;
             <http://xmlns.com/foaf/0.1/name> "Chimezie Ogbuji" ];
         doap:name "GRDDL.py";
         doap:shortdesc """
    A sample implementation of GRDDL in python
  """@en .
    
    dan:dwc     a <http://xmlns.com/foaf/0.1/Person>;
         <http://xmlns.com/foaf/0.1/homepage> <http://www.w3.org/People/Connolly/>;
         <http://xmlns.com/foaf/0.1/name> "Dan Connolly" .
      [      a :Assertion;
             :assertedBy dan:dwc;
             :test tes:projectsSpreadsheet;
             :testResult  [
                 a :TestResult;
                 :validity :pass ];
             :testSubject p:grddl_py ].
    
      [      a :Assertion;
             :assertedBy dan:dwc;
             :test tes:xmlWithGrddlAttribute;
             :testResult  [
                 a :TestResult;
                 :validity :pass ];
             :testSubject p:grddl_py ].
    
      [      a :Assertion;
             :assertedBy dan:dwc;
             :test tes:sq1a;
             :testResult  [
                 a :TestResult;
                 :validity :pass ];
             :testSubject p:grddl_py ].
    
      [      a :Assertion;
             :assertedBy dan:dwc;
             :test tes:atomttl1;
             :testResult  [
                 a :TestResult;
                 :validity :pass ];
             :testSubject p:grddl_py ].
    
      [      a :Assertion;
             :assertedBy dan:dwc;
             :test tes:rdfa1;
             :testResult  [
                 a :TestResult;
                 :validity :pass ];
             :testSubject p:grddl_py ].
    
      [      a :Assertion;
             :assertedBy dan:dwc;
             :test tes:base-param;
             :testResult  [
                 a :TestResult;
                 :validity :fail ];
             :testSubject p:grddl_py ].
    
#ENDS





Received on Sunday, 14 January 2007 10:37:36 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 8 January 2008 14:18:27 GMT