[contents]

W3C

Requirements for the Evaluation and Report Language (EARL) 1.0

W3C Editors' Draft 21 April 2009

This version:
http://www.w3.org/TR/2005/WD-EARL10-Requirements-20050711
Latest version:
http://www.w3.org/TR/EARL10-Requirements
Editors:
Michael Squillace, IBM Corporation

Abstract

This document describes the requirements for the scope, design, and features of the Evaluation and Report Language (EARL) 1.0 framework. The Evaluation and Report Language is a set of specifications and technical notes describing a standardized format for expressing test results. The primary motivation for developing this framework is to facilitate the exchange of test results between Web accessibility evaluation tools in a vendor-neutral and platform-independent format. It will also provide reusable vocabularies for more generic applications, such as Web quality assurance and validation tools.

Status of this Document

This section describes the status of this document at the time of its publication. Other documents may supersede this document. A list of current W3C publications and the latest revision of this technical report can be found in the W3C technical reports index at http://www.w3.org/TR/.

The Evaluation and Repair Tools Working Group (ERT WG) encourages feedback about this document, Requirements for the Evaluation and Report Language (EARL) 1.0, by Web developers and researchers who have interest in software-supported evaluation and validation of Web sites. In particular, the group is looking for feedback about the consistency, feasibility, and completeness of these requirements, together with how well they might support more generic applications such as Web quality assurance and validation tools.

The purpose of Requirements for EARL 1.0 is to focus and guide the development of EARL 1.0 to Recommendation status. The ERT WG was rechartered in 2008 to resume work on the EARL 1.0 Working Draft of 23 March 2007. While the ERT WG had previously made significant progress on the EARL 1.0 Working Draft, the group had never produced a requirements document. The ERT WG has developed Requirements for EARL 1.0 in order to ensure clarity and consensus on the goals for EARL 1.0 before its completion.

Please send comments to the mailing list of the ERT WG. The archives for this list are publicly available.

This is a W3C First Public Working Draft of the Requirements for the Evaluation and Report Language (EARL) 1.0. This document will be published and maintained as a W3C Working Group Note after review and refinement. Publication as a Working Draft does not imply endorsement by the W3C Membership. This is a draft document and may be updated, replaced or obsoleted by other documents at any time. It is inappropriate to cite this document as other than work in progress.

This document has been produced as part of the W3C Web Accessibility Initiative (WAI). The ERT WG is part of the WAI Technical Activity. The goals of the ERT WG are discussed in the Working Group charter.


Table of Contents


Introduction

On ??? 2008, the ERT Working Group was chartered to continue the development of EARL 1.0. The following is a collection of requirements set forth by the Working Group. Each requirement is labeled with one of the following key words:

WILL
The collection of specifications and technical notes that comprise the framework produced by the WG must satisfy this requirement.
SHOULD
The collection of specifications and technical notes that comprise the framework produced by the WG must address this requirement.
MAY
The collection of specifications and technical notes that comprise the framework produced by the WG can exclude this requirement.

1. Scope

S01
EARL 1.0 will be a set of vocabularies for describing test results.
S02
EARL 1.0 will be sufficiently complete to describe test results from the domain of Web accessibility evaluation.
S03
EARL 1.0 will be abstract enough to describe test results in other domains or contexts, such as Web quality assurance or Web Security.
S04
EARL 1.0 may be generic enough to describe test results eminating from testing non-web artifacts.

2. Design

D01
EARL 1.0 will define its constituent vocabularies each as a RDF Schema as defined by the RDF Vocabulary Description Language 1.0
D02
EARL 1.0 will be developed and published according to the W3C QA Framework: Specification Guidelines.
D03
EARL 1.0 will be machine-readable within reasonable time.
Editorial Note: the term reasonable time is ambiguous. See the message about machine processable constraint for more information.
D04
EARL 1.0 should reuse existing vocabularies whenever possible and appropriate.
D05
EARL 1.0 will support the extension of its core vocabulary to specific domains, including the domain of Web accessibility evaluation.
D06
EARL 1.0 will support automated, semi-automated, or manual testing.
D07
EARL 1.0 will provide vocabularies that supports internationalization.
D08
EARL 1.0 will define a conformance model consisting of a minimal set of required vocabularies and restrictions on how to use them.

3. Features

F01
EARL 1.0 will provide vocabularies for describing the context in which the results were obtained.
F02
EARL 1.0 will provide mechanisms to relate test results with the specific location within the subject that triggered the result where applicable.
F03
EARL 1.0 should support persistency of the validity of the results with respect to modifications or variations of the subject due to its dynamic nature where applicable.
F04
EARL 1.0 will support aggregation of test results according to different criteria (for example with respect to the subject).
--=_mixed 005AB144862575A5_=--