W3C home > Mailing lists > Public > public-wai-evaltf@w3.org > January 2012

Re: EvalTF Size of Sample

From: Shadi Abou-Zahra <shadi@w3.org>
Date: Thu, 05 Jan 2012 15:00:36 +0100
Message-ID: <4F05AD04.60008@w3.org>
To: Eric Velleman <evelleman@bartimeus.nl>
CC: "public-wai-evaltf@w3.org" <public-wai-evaltf@w3.org>
I am wondering if there is a way to have a more dynamic approach?

For example, the default "base sample" could be as little as 6 pages but 
the sample would grow depending on the features available on the website 
(forms, tables, multimedia, scripting, PDF, etc.) and on the (estimated) 
overall size of the website.

I think the concept of "sample lists" heads in that direction but we 
need to make these lists more modular. This way very simple websites 
would have smaller sample sizes than larger and/or more complex ones.


On 4.1.2012 00:14, Velleman, Eric wrote:
> Dear all,
> We had a short discussion in our last telco about the size of a representative sample of a website.
> The discussion varied between 6 and 5000... How many pages should we have in a sample to be replicable and at the same time achievable in terms of time and money?
> In the updated version of the Methodology that will be online in the coming days I added:
> - the three sample lists that should be included into an evaluation (core, task-based and random). If we just take one of every resource named there, we have at least 25 pages.
> Kindest regards,
> Eric
> =========================
> Eric Velleman
> Technisch directeur
> Stichting Accessibility
> Universiteit Twente
> Oudenoord 325,
> 3513EP Utrecht (The Netherlands);
> Tel: +31 (0)30 - 2398270
> www.accessibility.nl / www.wabcluster.org / www.econformance.eu /
> www.game-accessibility.com/ www.eaccessplus.eu
> Lees onze disclaimer: www.accessibility.nl/algemeen/disclaimer
> Accessibility is Member van het W3C
> =========================

Shadi Abou-Zahra - http://www.w3.org/People/shadi/
Activity Lead, W3C/WAI International Program Office
Evaluation and Repair Tools Working Group (ERT WG)
Research and Development Working Group (RDWG)
Received on Thursday, 5 January 2012 14:03:28 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 20:40:19 UTC