Using webservices for RDFa test suite validation

Here's a proof-of-concept implementation of what Ivan had mentioned
earlier today in the following thread:

http://www.nabble.com/pyRDFa-Test-Suite-Reviewer-tf4631832.html#a13226355

The new tool, crazyivan.py[1], will do the following:
 - Retrieve all approved or unreviewed RDFa test cases from the W3C.
 - Use the pyRDFa Distiller web service[2] to convert to RDF and run a
   modified SPARQL query from the test suite using the sparqler
   interface[3].
 - Dump the XHTML, N3 triples, RDF, and SPARQL to separate files.
 - Generate a test report, containing all the information necessary
   (XHTML, N3, RDF, and SPARQL), to understand the test case.

Things to note about this implementation:
 - It uses RDF and SPARQL web services to run the entire test suite.
 - Many more of the tests succeed now that we're using up-to-date
   implementations.
 - Sometimes (roughly 1 in 500 tests) a unit test will fail because
   (surprise, surprise) the HTTP GET fails due to some sort of
   internal website/webservice error.

All of the current XHTML, N3, RDF and review files are included in the
attached .tar.bz2, in a directory called "online-review".

The test doesn't require anything but a working version of Python and
python-rdflib (and that's only because the test RDF manifest has to be
queried).

[1] http://en.wikipedia.org/wiki/Crazy_Ivan
[2] http://www.w3.org/2007/08/pyRdfa/
[3] http://www.sparql.org/sparql.html

------------------------------------------------------------------
Command line output from the crazyivan.py tool:

test-online-01-approved (__main__.RDFaOnlineTest) ... ok
test-online-06-approved (__main__.RDFaOnlineTest) ... ok
test-online-07-approved (__main__.RDFaOnlineTest) ... ok
test-online-08-approved (__main__.RDFaOnlineTest) ... ok
test-online-09-approved (__main__.RDFaOnlineTest) ... ok
test-online-10-approved (__main__.RDFaOnlineTest) ... ok
test-online-11-approved (__main__.RDFaOnlineTest) ... FAIL
test-online-12-approved (__main__.RDFaOnlineTest) ... ok
test-online-13-approved (__main__.RDFaOnlineTest) ... ok
test-online-14-approved (__main__.RDFaOnlineTest) ... ok
test-online-15-approved (__main__.RDFaOnlineTest) ... ok
test-online-18-approved (__main__.RDFaOnlineTest) ... ok
test-online-19-approved (__main__.RDFaOnlineTest) ... ok
test-online-20-approved (__main__.RDFaOnlineTest) ... ok
test-online-21-approved (__main__.RDFaOnlineTest) ... ok
test-online-23-approved (__main__.RDFaOnlineTest) ... ok
test-online-25-approved (__main__.RDFaOnlineTest) ... ok
test-online-26-approved (__main__.RDFaOnlineTest) ... ok
test-online-27-approved (__main__.RDFaOnlineTest) ... ok
test-online-29-approved (__main__.RDFaOnlineTest) ... FAIL
test-online-30-approved (__main__.RDFaOnlineTest) ... ok
test-online-31-approved (__main__.RDFaOnlineTest) ... ok
test-online-32-approved (__main__.RDFaOnlineTest) ... ok
test-online-33-approved (__main__.RDFaOnlineTest) ... ok
test-online-34-approved (__main__.RDFaOnlineTest) ... ok
test-online-35-approved (__main__.RDFaOnlineTest) ... ok
test-online-36-approved (__main__.RDFaOnlineTest) ... ok
test-online-37-approved (__main__.RDFaOnlineTest) ... ok
test-online-38-approved (__main__.RDFaOnlineTest) ... ok
test-online-41-approved (__main__.RDFaOnlineTest) ... ok
test-online-46-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-47-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-48-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-49-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-50-unreviewed (__main__.RDFaOnlineTest) ... FAIL
test-online-51-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-52-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-53-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-54-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-55-unreviewed (__main__.RDFaOnlineTest) ... ok
test-online-56-unreviewed (__main__.RDFaOnlineTest) ... ERROR

-- manu

-- 
Manu Sporny
President/CEO - Digital Bazaar, Inc.
blog: Bitmunk Launches World's First Open Music Recommendation Service
http://blog.digitalbazaar.com/2007/09/09/bitmunk-music-recommendation/