W3C home > Mailing lists > Public > public-wai-evaltf@w3.org > January 2012

AW: EvalTF Size of Sample

From: Kerstin Probiesch <k.probiesch@googlemail.com>
Date: Thu, 5 Jan 2012 14:29:36 +0100
To: "'Velleman, Eric'" <evelleman@bartimeus.nl>, <public-wai-evaltf@w3.org>
Message-ID: <4f05a598.812f0e0a.303f.1b9f@mx.google.com>
Hi Eric, all,

before speaking about the size of a sample (I'm still not convinced of a
procedure, which is testing every time complete pages) I find it important,
having an agreement about the test itself. Do we have in mind 

- a simple checklist with pass/fail or any other results (this it seems is
not important at this point)
- are we speaking of a test with results and descriptions of the failure
- do we have a test in mind which includes results and for every SC the
description of the failures, including detailed tips how to solve them?

Or do we speak about all these possibilities? 

Each one will need different time and will therefore influence the price of
a test and eventually the size of sample. Some testing organizations might
"just" check with a checklist and are offering the consultant after. In this
case a client will pay for the test and for the consultance. Other
institutions might prefer a mix of test and consultance. In this case a
client would pay more for the test, but after less because of the detailed
tips as integral part of the test.




> -----Ursprüngliche Nachricht-----
> Von: Velleman, Eric [mailto:evelleman@bartimeus.nl]
> Gesendet: Mittwoch, 4. Januar 2012 00:15
> An: public-wai-evaltf@w3.org
> Betreff: EvalTF Size of Sample
> Dear all,
> We had a short discussion in our last telco about the size of a
> representative sample of a website.
> The discussion varied between 6 and 5000... How many pages should we
> have in a sample to be replicable and at the same time achievable in
> terms of time and money?
> In the updated version of the Methodology that will be online in the
> coming days I added:
> - the three sample lists that should be included into an evaluation
> (core, task-based and random). If we just take one of every resource
> named there, we have at least 25 pages.
> Kindest regards,
> Eric
> =========================
> Eric Velleman
> Technisch directeur
> Stichting Accessibility
> Universiteit Twente
> Oudenoord 325,
> 3513EP Utrecht (The Netherlands);
> Tel: +31 (0)30 - 2398270
> www.accessibility.nl / www.wabcluster.org / www.econformance.eu /
> www.game-accessibility.com/ www.eaccessplus.eu
> Lees onze disclaimer: www.accessibility.nl/algemeen/disclaimer
> Accessibility is Member van het W3C
> =========================
Received on Thursday, 5 January 2012 22:01:33 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 20:40:19 UTC