Fwd: experience generating EARL for GRDDL test results

There is a discussion which has been started on EARL and GRDDL test.
See http://lists.w3.org/Archives/Public/public-wai-ert/2007Jan/0001

Début du message réexpédié :
> The GRDDL WG is working on a test suite
>   http://www.w3.org/2001/sw/grddl-wg/td/testlist1
>
> I'm interested to have test results from various
> implementations aggregated, the way Sandro did for
> the OWL tests.
> http://www.w3.org/QA/2006/11/celebrating_owl_interoperabili.html
>
> So I updated our test harness so that it produces EARL; for
> each test, you get something like:
>
>       [      a :Assertion;
>              :assertedBy dan:dwc;
>              :test tes:sq1a;
>              :testResult  [
>                  a :TestResult;
>                  :validity :pass ];
>              :testSubject p:grddl_py ].

interesting.

    [[[ How to run the tests

     We provide testft.py, a test driver, based on rdflib 2.3.3
    and 4suite, specifically 4Suite-XML-1.0.tar.gz. Run it a la:

     $ python testft.py --run your_grddl_impl testlist1.rdf
    >earl_out.rdf All tests were passed!

     It has options for --debug and such; invoke it with no
    arguments for details. ]]]

     -- GRDDL Tests, Part 1
    http://www.w3.org/2001/sw/grddl-wg/td/testlist1 Fri, 12 Jan
    2007 23:28:43 GMT

http://www.w3.org/2001/sw/grddl-wg/td/testft.py

> Do you have any tools to make nice HTML reports out of EARL data?

I see one possible problems though. EARL is extensible (RDF nature)  
and might be very application dependant. The layout might be very  
different from one application to another one.


in 2001, I see a first discussion about this
http://lists.w3.org/Archives/Public/w3c-wai-er-ig/2001Aug/0031

BUT There is  "EARL to XHTML" by Sean B. Palmer
http://lists.w3.org/Archives/Public/w3c-wai-er-ig/2002Feb/0026
http://lists.w3.org/Archives/Public/w3c-wai-er-ig/2002Feb/att-0026/ 
template.py
http://lists.w3.org/Archives/Public/w3c-wai-er-ig/2002Feb/att-0026/ 
earltemplate.py
http://lists.w3.org/Archives/Public/w3c-wai-er-ig/2002Feb/att-0026/ 
earltemplate.html




There was this tool developed a long time ago. It is for running  
tests and generate an EARL report. There is no maintainer for this  
tool, but as usual it is open source, if someone wants to give a kick.


     MUTAT - Developer information

     MUTAT is a simple cgi script to demonstrate possible uses of
     EARL, and also use of RDF to configure an application. It is
     designed to help perform Quality Assurance evaluation tasks.

     http://www.w3.org/QA/Tools/MUTAT/

In the code I can see
http://dev.w3.org/cvsweb/perl/modules/W3C/MUTAT/mutat? 
rev=1.10&content-type=text/x-cvsweb-markup

#
# There needs to be a bunch of work on this to update it...
# It should also offer the choice of an EARL report or an HTML human- 
readable report.
#
# At the point where we can read in existing EARL, this will become  
useful for building tables
#  to compare results. Insha'allah...


* Markup Validator

For the markup validator, there are different types of output,  
including EARL, but no transformation from EARL to HTML

http://validator.w3.org/docs/users.html#Output
For the EARL/n3 template
http://dev.w3.org/cvsweb/validator/share/templates/en_US/earl_n3.tmpl? 
rev=1.2&content-type=text/x-cvsweb-markup

* Hera
http://www.sidar.org/hera/index.php.en?ini=help







-- 
Karl Dubost - http://www.w3.org/People/karl/
W3C Conformance Manager, QA Activity Lead
   QA Weblog - http://www.w3.org/QA/
      *** Be Strict To Be Cool ***

Received on Monday, 15 January 2007 02:49:52 UTC