Re: EARL based self-contained regression tests?

Hi Nils,

This is indeed a use case. However, the issue with this is that it generates huge reports. Basically a full copy of all the tested resources (+ some EARL metadata that may become negligible with this amount of data).

Thus, most evaluation tools will probably omit recording the actual HTTP content (payload). I imagine tools may become "intelligent" and only use the earl:WebContent class when specific HTTP parameters are essential to describe the tested resources (for example, on a site that can be personalized or uses sessions). But this is a different discussion... ;)

Regards,
  Shadi


Nils Ulltveit-Moe wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Hi,
> 
> The suggested support for HTTP header and content could be used for an
> EARL-based self-contained regression test for web content. I do not know
> if this is a new use case for EARL?
> 
> Below is an example of a self contained EARL report, according to the
> suggested format for embedding http request/response and HTML document
> in EARL, that could be used for this.
> 
> To perform a regression test, one would have to re-assess the document
> with the tool to be tested, and verify that the assertion result from
> the accessibility assessment tool contained the assessment result in the
> self-contained EARL.
> 
> 
> The suggested format for embedding HTTP and content in RDF/EARL is here:
> 
> http://www.w3.org/WAI/ER/HTTP/WD-HTTP-in-RDF-20060131
> 
> Mvh.
> Nils Ulltveit-Moe
> 
> Example on a self-contained EARL for WAM system test:
> 
> <?xml version="1.0" encoding="utf-8"?>
> <rdf:RDF
>   xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
>   xmlns:earl="http://www.w3.org/WAI/ER/EARL/nmg-strawman#"
>   xmlns:http="http://www.w3.org/1999/xx/http#"
>   xmlns:rfc822="http://www.example.org/rfc822#"
>   xmlns:foaf="http://xmlns.com/foaf/0.1/"
>   xmlns:eiao="http://www.eiao.net/rdf/1.0#"
>   xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#"
>   xmlns:dc="http://purl.org/dc/elements/1.1/"
>   xmlns:dct="http://purl.org/dc/terms/"
>   xml:base="http://www.eiao.net/rdf/1.0/#">
> 
> <earl:TestSubject rdf:about="http://www.example.com">
>   <dc:title xml:lang="en">Automatically sampled by EIAO
> Observatory</dc:title>
>   <dc:date
> rdf:datatype="http://www.w3.org/2001/XMLSchema#gDate">2006-02-16
> 02:20+0100</dc:date>
> </earl:TestSubject>
> 
> <earl:Software rdf:about="http://www.eiao.net/1.0/SystemTest/">
>   <dc:title xml:lang="en">System test for EIAO Observatory</dc:title>
>   <dc:description xml:lang="en">Self-contained EARL regression test
> example.</dc:description>
>   <dct:hasVersion>0.2</dct:hasVersion>
> </earl:Software>
> 
> <earl:TestRequirement rdf:ID="requirement">
>   <dc:title xml:lang="en">EIAO.B10.00.00.001.001-001.001</dc:title>
>   <dc:description xml:lang="en">Valudation passed</dc:description>
> </earl:TestRequirement>
> 
> <earl:Assertion rdf:ID="expectedResults">
>         <earl:assertedBy
> rdf:resource="http://www.eiao.net/1.0/SytstemTest/"/>
>         <earl:subject rdf:resource="#webcontent"/>
>         <earl:requirement rdf:resource="#requirement"/>
>         <earl:mode
> rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#automatic"/>
>         <earl:result rdf:parseType="Resource">
>               <earl:validity
> rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#pass"/>
>         </earl:result>
>         <eiao:singleLocation rdf:resource="#line"/>
> </earl:Assertion>
> 
> <eiao:SingleLocation rdf:ID="line">
>         <eiao:line>0</eiao:line>
>         <eiao:column>0</eiao:column>
> </eiao:SingleLocation>
> 
>   <earl:WebContent rdf:ID="webcontent">
>     <earl:httpRequest>
>       <http:GetRequest>
>         <http:host>www.example.org</http:host>
>         <http:port>80</http:port>
>         <http:absPath>/</http:absPath>
>         <http:version>1.1</http:version>
>         <http:accept>text/html;q=1.0, */*;q=0.01</http:accept>
>         <http:acceptLanguage>de-DE;q=1.0, de;q=0.75, en-GB;q=0.5,
> en;q=0.25, *;q=0.01</http:acceptLanguage>
>       </http:GetRequest>
>     </earl:httpRequest>
>     <earl:httpResponse>
>       <http:Response>
>         <http:contentType>text/html;charset=utf-8</http:contentType>
>         <http:vary>negotiate, accept, accept-language</http:vary>
>         <http:additionalHeader>
>           <rfc822:Field>
>             <rfc822:fieldName>x-foo</rfc822:fieldName>
>             <rfc822:fieldBody>bar</rfc822:fieldBody>
>           </rfc822:Field>
>         </http:additionalHeader>
>         <http:body rdf:parseType="Resource">
>           <http:bodyContent><![CDATA[<html><title>Document to be
> assessed...</title></html>]]></http:bodyContent>
>           <http:bodyEncoding>text/plain</http:bodyEncoding>
>         </http:body>
>       </http:Response>
>     </earl:httpResponse>
>   </earl:WebContent>
> </rdf:RDF>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.2 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
> 
> iD8DBQFD9Oe2+uAhaUHEvIoRAm+fAJ9ZeAuRi6uw2hnOcdGYNUT0UtsRigCeLYwf
> d4PpEIZ/PWVI+Eo5MgSFKg0=
> =Q4R8
> -----END PGP SIGNATURE-----
> 
> 

-- 
Shadi Abou-Zahra     Web Accessibility Specialist for Europe | 
Chair & Staff Contact for the Evaluation and Repair Tools WG | 
World Wide Web Consortium (W3C)           http://www.w3.org/ | 
Web Accessibility Initiative (WAI),   http://www.w3.org/WAI/ | 
WAI-TIES Project,                http://www.w3.org/WAI/TIES/ | 
Evaluation and Repair Tools WG,    http://www.w3.org/WAI/ER/ | 
2004, Route des Lucioles - 06560,  Sophia-Antipolis - France | 
Voice: +33(0)4 92 38 50 64          Fax: +33(0)4 92 38 78 22 |

Received on Thursday, 16 February 2006 22:37:16 UTC