W3C home > Mailing lists > Public > w3c-wai-gl@w3.org > October to December 2001

Re: test cases

From: Scott Luebking <phoenixl@sonic.net>
Date: Tue, 4 Dec 2001 15:42:25 -0800
Message-Id: <200112042342.fB4NgPe7011958@newbolt.sonic.net>
To: w3c-wai-gl@w3.org
Hi,

It might be helpful to look at test cases which have been used for
researching usability of the web.  Also taking a look at the test
cases used by Neil Jakobson in his recent research on web page
accessibility might be useful.  Rather than starting from scratch,
looking at test cases used by other people could give some insight
into useful characteristics of test cases.

Scott

> Absolutely.   Test cases (both selected and random) need to be a key
> part of our evaluation process.  In fact, procedure I think you are
> suggesting is just what has been discussed though not formalized. 
> 
> So let's take this opportunity to begin that process.  
> 
> 
> Let me pose the following to begin discussion.
> 
> 
> 1  -  create a collection of representative (as much as there is such a
> thing) pages or sites that sample the RANGE of different pages,
> approaches and technologies on the Web.
> 2 - look at the items (particularly success criteria)  -  identify any
> additional sample pages or sites needed to explore the item (if sample
> is not good enough to)
> 3 -  run quick tests by team members with these stimuli to see if
> agreement.  If team agrees that it fails, work on it.  If it passes team
> or is ambiguous then test move on to testing with external sample of
> people while fixing any problems identified in the internal screening
> test. 
> 4 -  proceed in this manner to keep improving items and learning about
> objectivity or agreement as we move toward the final version and final
> testing.
> 5 -  in parallel with the above, keep looking at the items with the
> knowledge we acquire and work to make items stronger
> 
> 
> The key to this is the Test Case Page Collection.  We have talked about
> this.  But no one has stepped forward to help build it.   Can we form a
> side team to work on this?
> 
> 
> 
> NOTE: the above is a VERY rough description of a procedure as I run to a
> meeting.   But I would like to see if we can get this ball rolling.
> Comments and suggestions welcome.    
> 
> Gregg
Received on Tuesday, 4 December 2001 18:42:32 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 7 December 2009 10:47:16 GMT