Re: Home Page for EARL

Hi Paul,


Paul Walsh wrote:
> The only single item I can see that we don't use, is confidence levels.
> According to our process, a test case either passes or fails, anything
> in between is not a final 'result'.
[SNIP]
> For example, if an automated tool produces an uncertainty and human 
> interaction is required to verify the integrity of the result, the 
> result is not actually published until the human interaction confirms a 
> pass or fail.

How do you record a non-final result from the tool for a human to verify at a later point in time? A possible scenario would be an EARL repository of various results from different sources. Queries could be run over that repository to generate different reports. Here a couple of examples:

* an expert evaluator wants a list of all non-final results for a specific test case
* a Web developer wants a list of all (final) failed results for a specific Web page
* a project manager wants a list of false results generated by a specific eval tool



> Going back to your request, I can also add that New Media Age (NMA) is 1
> of 2 new media publications in the UK. They contacted me last week to
> see if Segala was working on anything that they could report on. They
> are keen to cover our story regarding our partnership with ICRA and the
> use of RDF. The story will be covered in next week's edition. Is this
> what you were looking for?

Please let me know when the article is published. If it is helpful as an EARL resource, I will be happy to include it on the resource page.



> I intend to promote the use of EARL within the Mobile Web Initiative.  I
> have already referred to it in my first draft of the conformance
> specification.

Great! Please let us know if you make any observations of how EARL is used in MWI, and how well it satisfies their requirements.


Regards,
  Shadi


-- 
Shadi Abou-Zahra,     Web Accessibility Specialist for Europe 
Chair and Team Contact for the Evaluation and Repair Tools WG 
World Wide Web Consortium (W3C),           http://www.w3.org/ 
Web Accessibility Initiative (WAI),    http://www.w3.org/WAI/ 
WAI-TIES Project,                 http://www.w3.org/WAI/TIES/ 
Evaluation and Repair Tools WG,     http://www.w3.org/WAI/ER/ 
2004, Route des Lucioles -- 06560, Sophia-Antipolis -- France 
Voice: +33(0)4 92 38 50 64           Fax: +33(0)4 92 38 78 22

Received on Wednesday, 17 August 2005 09:30:25 UTC