W3C home > Mailing lists > Public > public-wai-evaltf@w3.org > January 2012

Re: EvalTF Size of Sample

From: Michael S Elledge <elledge@msu.edu>
Date: Thu, 05 Jan 2012 09:59:41 -0500
Message-ID: <4F05BADD.4050706@msu.edu>
To: public-wai-evaltf@w3.org
I also think that the "correct" number of pages in a sample will vary 
according to intention, budget, website size and complexity. That 
doesn't trouble me so long as the person(s) doing the evaluation clearly 
state the scope of their work, so there is no misunderstanding.

Providing general guidance in the way of examples or ranges will 
probably be the most specific we can be, and likely to be the most 
helpful approach as well.

Mike

On 1/5/2012 9:00 AM, Shadi Abou-Zahra wrote:
> I am wondering if there is a way to have a more dynamic approach?
>
> For example, the default "base sample" could be as little as 6 pages 
> but the sample would grow depending on the features available on the 
> website (forms, tables, multimedia, scripting, PDF, etc.) and on the 
> (estimated) overall size of the website.
>
> I think the concept of "sample lists" heads in that direction but we 
> need to make these lists more modular. This way very simple websites 
> would have smaller sample sizes than larger and/or more complex ones.
>
> Best,
>   Shadi
>
>
> On 4.1.2012 00:14, Velleman, Eric wrote:
>> Dear all,
>>
>> We had a short discussion in our last telco about the size of a 
>> representative sample of a website.
>> The discussion varied between 6 and 5000... How many pages should we 
>> have in a sample to be replicable and at the same time achievable in 
>> terms of time and money?
>>
>> In the updated version of the Methodology that will be online in the 
>> coming days I added:
>> - the three sample lists that should be included into an evaluation 
>> (core, task-based and random). If we just take one of every resource 
>> named there, we have at least 25 pages.
>>
>> Kindest regards,
>>
>> Eric
>>
>> =========================
>> Eric Velleman
>> Technisch directeur
>> Stichting Accessibility
>> Universiteit Twente
>>
>> Oudenoord 325,
>> 3513EP Utrecht (The Netherlands);
>> Tel: +31 (0)30 - 2398270
>> www.accessibility.nl / www.wabcluster.org / www.econformance.eu /
>> www.game-accessibility.com/ www.eaccessplus.eu
>>
>> Lees onze disclaimer: www.accessibility.nl/algemeen/disclaimer
>> Accessibility is Member van het W3C
>> =========================
>>
>>
>
Received on Thursday, 5 January 2012 15:00:47 GMT

This archive was generated by hypermail 2.3.1 : Friday, 8 March 2013 15:52:12 GMT