W3C home > Mailing lists > Public > public-wai-ert@w3.org > June 2007

Issue #8: Extensibility of outcome values

From: Carlos Iglesias <carlos.iglesias@fundacionctic.org>
Date: Tue, 5 Jun 2007 00:22:51 +0200
Message-ID: <09700B613C4DD84FA9F2FEA521882819020C6A17@ayalga.fundacionctic.org>
To: <public-wai-ert@w3.org>


Hi group,

After our initial discussion about EARL's issue #8 [1] at the last teleconference I'm going to try to summarize my point of view about current constraints applied to outcomes to facilitate further discussion.

Even when the general "spirit" of RDF is to be as open as possible, IMO there will be always certain constraints that are necessary when modelling, especially when you're dealing with well defined scenarios as the world of software testing or QA in general are.

The current model is apparently robust enough to cover every use case we have found until now. Apparently, there is no request at the moment we could not cover using one of the current classes, or creating subclasses of them if further shades of meaning are necessary. Additionally outcomes has been one of the more stable and interoperable parts historically in EARL, which could be seen as a proof of its completeness.

With respect to the new potential use case mentioned (performance testing), I still think that if you want to record "validity" results (you may define a minimum performance to pass or fail) one of the current values could be used also without any problem, but I also think that this new use case could show us that we may need a new TestResult property (or properties) to help us record this kind of measures.

E.g. we could use a readability test that outputs a readability value in a scale from 0 to 100, and we have defined a test case where we need a 70 value to pass the test. If we run the test case and get a score of 60, we should record a fail as a result but we may obviously also want to record the specific value of the measure (60) for the record.

Finally, if we choose to provide a completely open model for the outcome values, we should be aware of the fact that interoperability could be seriously reduced once people decide to create new outcome values for those that should be just variants of the current ones. Additionally we will leave the door open to potentially "bad practices" as the use of new "warning" outcome values could be.


[1] - [http://www.w3.org/WAI/ER/EARL10/issues#outcomes]

Regards,
 CI.

--------------------------------------

Carlos Iglesias

CTIC Foundation
Science and Technology Park of Gijón
33203 - Gijón, Asturias, Spain 

phone: +34 984291212
fax: +34 984390612
email: carlos.iglesias@fundacionctic.org
URL: http://www.fundacionctic.org 
Received on Monday, 4 June 2007 22:23:14 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 8 January 2008 14:18:28 GMT