RE: Home Page for EARL

And below:
 
> -----Original Message-----
> From: public-wai-ert-request@w3.org
[mailto:public-wai-ert-request@w3.org] On
> Behalf Of Shadi Abou-Zahra
> Sent: 17 August 2005 10:30
> To: Paul Walsh
> Cc: public-wai-ert@w3.org
> Subject: Re: Home Page for EARL
> 
> 
> Hi Paul,
> 
> 
> Paul Walsh wrote:
> > The only single item I can see that we don't use, is confidence
levels.
> > According to our process, a test case either passes or fails,
anything
> > in between is not a final 'result'.
> [SNIP]
> > For example, if an automated tool produces an uncertainty and human
> > interaction is required to verify the integrity of the result, the
> > result is not actually published until the human interaction
confirms a
> > pass or fail.
> 
> How do you record a non-final result from the tool for a human to
verify at a later
> point in time? A possible scenario would be an EARL repository of
various results from
> different sources. Queries could be run over that repository to
generate different
> reports. Here a couple of examples:
[PW] Currently a result that's between states doesn't need to be
'published' as the time it takes to re-evaluate to get a pass or fail is
so short it wouldn't be worth it - almost immediately. In answer to your
question, a spreadsheet is likely to be used. However, if we use EARL to
record test cases and results throughout a project, I would see us using
the in-between state where a result may take more than a few hours to
achieve.
> 
> * an expert evaluator wants a list of all non-final results for a
specific test case
> * a Web developer wants a list of all (final) failed results for a
specific Web page
> * a project manager wants a list of false results generated by a
specific eval tool
[PW] We capture all of these in our own tool. However, I'd like to turn
to EARL if possible/feasible.
> 
> 
> 
> > Going back to your request, I can also add that New Media Age (NMA)
is 1
> > of 2 new media publications in the UK. They contacted me last week
to
> > see if Segala was working on anything that they could report on.
They
> > are keen to cover our story regarding our partnership with ICRA and
the
> > use of RDF. The story will be covered in next week's edition. Is
this
> > what you were looking for?
> 
> Please let me know when the article is published. If it is helpful as
an EARL resource, I
> will be happy to include it on the resource page.
[PW] I've just received a copy from their publications department, see
attachment - it will appear on page 3. Unfortunately they have slightly
misinterpreted the last bit; Segala 'providing software code' to ICRA.
It doesn't mention EARL/RDF specifically but it is referring to it in
essence. We intend to use RDF on the corporate responsibility report as
a proof of concept - not sure just how much detail it will include yet.
This is a small project with around 100 pages using approximately 15
templates sitting on a CMS with various news feeds.
 
Unfortunately the story went out by mistake as it was supposed to go out
next week following sign off from ICRA. 
> 
> 
> 
> > I intend to promote the use of EARL within the Mobile Web
Initiative.  I
> > have already referred to it in my first draft of the conformance
> > specification.
> 
> Great! Please let us know if you make any observations of how EARL is
used in MWI,
> and how well it satisfies their requirements.
[PW] I have recommended it to my colleagues on the committee. I've
included it in my conformance specification so I'll keep you posted!
 
Thanks
Paul
> 
> 
> Regards,
>   Shadi
> 
> 
> --
> Shadi Abou-Zahra,     Web Accessibility Specialist for Europe
> Chair and Team Contact for the Evaluation and Repair Tools WG
> World Wide Web Consortium (W3C),           http://www.w3.org/
> Web Accessibility Initiative (WAI),    http://www.w3.org/WAI/
> WAI-TIES Project,                 http://www.w3.org/WAI/TIES/
> Evaluation and Repair Tools WG,     http://www.w3.org/WAI/ER/
> 2004, Route des Lucioles -- 06560, Sophia-Antipolis -- France
> Voice: +33(0)4 92 38 50 64           Fax: +33(0)4 92 38 78 22