Raptor 1.4.15 testing with GRDDL Tests Cases W3C Working Draft 28th March 2007

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I was trying to run the tests attached to
http://www.w3.org/TR/2007/WD-grddl-tests-20070328/
using the test driver and the manifest file
with the released version of Raptor 1.4.15 (http://librdf.org/raptor)


Firstly some comments on the test packaging and driver.

It's also not clear in the files in the zip, which one is the manifest
file, there are lots of RDF files.  I guessed it was grddl-tests.rdf.  Maybe
the section 'Deliverables' could indicate this?

Would be nice to mention the test driver requires python2.4.
Otherwise you get mysterious errors like:
$ python testft.py --run "rapper -q -i grddl -o rdfxml-abbrev" grddl-tests.rdf
  File "testft.py", line 72
    g = ((isinstance(t,BNode) and self.vhash(t)) or t for t in triple)
                                                        ^
SyntaxError: invalid syntax
$

I'd suggest putting the URIs of the tests visible in the WD itself
(such as 'http://www.w3.org/2001/sw/grddl-wg/td/#noxinclude')
since it's hard to correlate the URIs in the test runner output
to the words in the document without mousing over to see
what the 'input' and 'output' link URIs actually are.

Either that or make the test runner print some nicer test
label that indicates which test failed.  The test URIs
themselves don't go to anything readable.



Running the tests with Raptor 1.4.15

My setup doesn't make it easy to run the tests offline, so this run
is using some local files (from the zip) and some from the web:

$ python testft.py --run "rapper -q -i grddl -o rdfxml-abbrev"
grddl-tests.rdf > earl_out.rdf
* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf-xmlmediatype3 failed
* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf-xmlmediatype2 failed
* http://www.w3.org/TR/grddl-tests/#langconneg2 failed
* http://www.w3.org/2001/sw/grddl-wg/td/#noxinclude failed
* http://www.w3.org/TR/grddl-tests/#loop failed
* http://www.w3.org/TR/grddl-tests/#sq1 failed
* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf2 failed
* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf3 failed



Interpretation of results

* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf-xmlmediatype3 failed
* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf-xmlmediatype2 failed
ok: only 1 of 3 tests need pass

* http://www.w3.org/TR/grddl-tests/#langconneg2 failed
ok: only 1 of 2 tests need pass

* http://www.w3.org/2001/sw/grddl-wg/td/#noxinclude failed
ok: since raptor does do xinclude processing this is ok to fail

* http://www.w3.org/TR/grddl-tests/#loop failed
maybe ok:

The expected result has one triple that uses rdf:about=""
it so varies depending on where you install or run it:
$ grep rdf:about loop-output.rdf
  <rdf:Description rdf:about="http://www.w3.org/2001/sw/grddl-wg/td/loop">
  <rdf:Description rdf:about="">

I think that means there is no well defined correct result.

Raptor does generate nearly the right 2 triples if called with one
base URI:
$ rapper -q -i grddl -o ntriples loop.xml
http://www.w3.org/2001/sw/grddl-wg/td/loop
<http://www.w3.org/2001/sw/grddl-wg/td/loop>
<http://purl.org/dc/elements/1.1/description> "an sq1 document" .
<http://www.w3.org/2001/sw/grddl-wg/td/loop>
<http://www.w3.org/2003/g/data-view#namespaceTransformation>
<http://www.w3.org/2001/sw/grddl-wg/td/sq1t.xsl> .


* http://www.w3.org/TR/grddl-tests/#sq1 failed
failure: related to dealing with finding RDF/XML content
during grddl processing.

I do notice http://www.w3.org/2001/sw/grddl-wg/td/sq1ns
is not of the RDF mime type, should it really be handled
as RDF/XML?

However as above the expected output is not well defined:
$ grep 'rdf:about=""' sq1-output.rdf
  <rdf:Description rdf:about="">


* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf3 failed
* http://www.w3.org/2001/sw/grddl-wg/td/#grddlonrdf2 failed
ok: only 1 of 3 need pass


Summary

Raptor 1.4.15 passes most of the 2007-03-28 GRDDL test cases.
I think it fails one: http://www.w3.org/TR/grddl-tests/#sq1
and I think one is in error: http://www.w3.org/TR/grddl-tests/#loop

Cheers

Dave
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGGxuIQ+ySUE9xlVoRAszvAJ9ELAczPqpkYLpt/TEfQQnNOzjpIgCgg3vl
3IxeCp2QqypmDJ5bT0qX0ww=
=1SGQ
-----END PGP SIGNATURE-----

Received on Tuesday, 10 April 2007 05:08:01 UTC