RE: Test document draft

> The only public 
> repository is the hg repository, which is currently only 
> updated manually.

Would you be so kind as to perform such an update?

> > - Two properties were suggested in an earlier John-l patch 
> [2] to capture (formally) the relationship between 
> alternative test outputs:
> 
> How are those properties consumed? Data that isn't consumed rots.

I'm glad you bring this up.  Even without any new code, if you simply
merge the graphs of the results with these definitions and the test
manifest, you get additional information about tests that failed.  For
example, GRDDL.py fails test <#xinclude>, but after merging we see why
this is:

  [ a earl:Assertion;
         earl:result [ a earl:TestResult;
                 earl:validity earl:fail];
         earl:test :noxinclude].

  :xinclude a test:Test;
         dc:title "Testing GRDDL when XInclude processing is enabled";
         alt:alternative :noxinclude.

  [ a earl:Assertion;
         earl:result [ a earl:TestResult;
                 earl:validity earl:pass];
         earl:test :xinclude].

Of course, this requires additional work on the part of the tester in
order to learn this information, but that's just the beginning.

If the WG was in favor of these terms, I was planning to augment the
test harness to be smarter about the reporting of test failure based
upon these terms.  In particular, if the test harness sees the failure
of a test that is an alt:alternative to another test that passes, then
it would indicate this (something along the lines of "this test failed,
but an alternate test passed").

Take care,

    John L. Clark





Cleveland Clinic is ranked one of the top 3 hospitals in
America by U.S.News & World Report. Visit us online at
http://www.clevelandclinic.org for a complete listing of
our services, staff and locations.


Confidentiality Note:  This message is intended for use
only by the individual or entity to which it is addressed
and may contain information that is privileged,
confidential, and exempt from disclosure under applicable
law.  If the reader of this message is not the intended
recipient or the employee or agent responsible for
delivering the message to the intended recipient, you are
hereby notified that any dissemination, distribution or
copying of this communication is strictly prohibited.  If
you have received this communication in error,  please
contact the sender immediately and destroy the material in
its entirety, whether electronic or hard copy.  Thank you.


===================================

Received on Wednesday, 14 March 2007 14:48:23 UTC