informal testing results

All,

Here are my results from testing of http://www.w3.org/2004/09/wai-nav/8-home.  Three tests were done - two in person and one "virtually".  Descriptions of Participants are at the end of email.
 

GENERAL COMMENTS:

Participant 1: Didn't like how links are not underlined on left nav (not clear that they are links) - color was hard to read.

 

Participant 2: did not like the way the WAI Overview page lead to the slides - she felt mislead.  She used the quicklinks for the UAAG question!

 

Participant 3 thought the right content was confusing and made the pages busy - would have liked that information to be on the left instead. Could not complete Task #6.  Likes "+" feature - would not expect to see the period for non-linking sections.  When saw "Governmental"  in "Governmental Policies Relating to Web Accessibility" thought of US government - suggested changing to International.  Was not sure what the difference was between Guidelines & Techniques and General links.  Didn't understand what "Standards Harmonization" was.  Likes links in text.

 

TASKS:

Task 1: Using the site answer the question: What is WAI?

P1: Left nav > About WAI > WAI Overview 

P2: Left nav > About WAI >WAI Overview> > Overview of the Web [link on page] - was upset this lead to slide show.  Asked why?  Felt it was misleading.  Wanted a short intro paragraph before link to slide show.

P3: Left nav > About WAI > WAI Overview

 

 

Task 2: Role Play: You are a web developer and you want some basic information on web accessibility.

P1: Left nav > Guidelines & Resources > Implementing 

P2: Left nav > Guidelines & Resources > Guidelines & Techniques [link on page]  - then went to General and then to Implementing.

P3: Left nav > Guidelines & Resources > General > Guidelines and Techniques >  Web Content Accessibility Guidelines (WCAG) Overview.  [Note: would look for "Accessibility"]

 

Task 3: If I want to evaluate a web site for accessibility where can I find resources that will help?

P1: Left nav > Guidelines & Resources > Evaluating

P2: Left nav > Guidelines & Resources > Evaluating Web Accessibility [link on page]

P3: Left nav > Guidelines & Resources > Evaluation > Evaluating Web Sites for Accessibility [note: commented that he expected this link in navigation - it is there]

 

 

Task 4a: Find the "UAAG 1.0 FAQ." 

P1: Left nav > Getting Started > UAAG Link > FAQ links on left side of page

P2: Used drop down for UAAG

P3: Left nav > Guidelines & Resources > UAAG [link on page] > on right box clicked FAQ

 

Task 4b: From the "UAAG 10 FAQ", "Find the UAAG 1.0 Testimonials"

P1: Could not find

P2: Back one page then in the Resources section - clicked on Testimonials

P3: Back one page then in the Resources section - clicked on Testimonials

 

- Is the presentation and interaction of the lower levels under the UAAG links understandable?

P1: I like the layout on the left - like a table of contents; don't like how much scrolling down a page there is of information; maybe find a way to break it up more?

P2: Obvious but not repetitive - not sure.  Should open dropdown - distracting with all three boxes - move nav to left side?  Make more like FAQ style with links at top of page instead of on right.

 

 

Task 5: You have been invited to be a presenter at a local conference on Web accessibility. Find information on this Web site that you could use in your talk.

P1: Left nav > About WAI >Participating

P2: N/A (skipped question)

P3: Left nav > Guidelines & Resources > WCAG > Checklist > wanted to click on "14 Guidelines" in What is in WCAG 1.0? paragraph.  Page contents were not clear here - wasn't sure as it blends in  - looked like different links.  [Note: The header spreading over the right section helps to identify it as being "within" that section.

 

Task 6: A company with many global divisions and Web sites in many languages has asked for your opinion on how Web accessibility laws differ around the world. Using this Web site, determine whether or not it contains relevant information.

P1: Left nav > Guidelines & Resources > Guidelines & Techniques > General

P2: Left nav > Guidelines & Resources > General > Policies Relating to Web Accessibility [link on page]

P3: Left nav > Guidelines & Resources > General Resources [link on page] - wasn't sure.  Then tried Implementing > then Guidelines & Resources - then gave up.

 

 

GENERAL QUESTIONS

1. How does the general information architecture and navigation design work? Could you perform the tasks? Was it easy, hard, so-so? 

P1: I realize not all functionality is there yet, but the drop-down and search link are not very user friendly.  Does the typical user know what the drop-down acronyms stand for prior to going to site?  Drop-down caught my eye right-away, but didn't understand the terms in it.  Left nav was usable.  Could have better use of color and make it more obvious that they are links (underlining, etc.)

P2: Include UAAG links in navigation - more content in navigation.  Found multiple fonts distracting.

 

2. Is the expanding and collapsing navigation concept intuitive?  Did you have to play with it or did you "get it" right away? 

P1: It could be more intuitive.  To collapse it I first tried to click on the empty check-box thinking that would collapse it again.  Instead you have to click another link the left nave for the existing one to collapse.

P2: Like navigation on left - more links on left instead of on right.

P3: on a scale of 1-10 found it a 6.  Likes it simple - found a lot of choices - too many.  Was unclear what [brackets] were for.

 

3. How comfortable or uncomfortable do you feel when one section of the navigation is expanded and the other sections are not? 

P1: I would prefer that if I expand a section that it remains expanded unless I purposely collapse it.  Lets you see better what is under each section if can have more than one section expanded simultaneously.

 

 

PARTICIPANT DETAILS

P1: Virtual tester - male, late 20's, web savvy

Occupation: Requirements and Testing

Role or Interest: N/A

Visits to WAI: None

Disability?  N/A

Involvement: 2 years?

 

P2: In person - female, late 20's, very web savvy

Occupation: IT Consultant

Role or Interest: Interested in front-end UI, used to develop pages. Experience in training material development makes me want to know how people accept new material.

Visits to WAI: N/A

Disability?  N/A

Involvement: 4+ Years

 

P3: In person - male, mid-20's, web savvy

Occupation: Technology Consultant

Role or Interest: Directly responsible for ensuring website comply with Section 508

Visits to WAI: 1 time

Disability?  N/A

Involvement: 2 Years



Best,
Carol J. Smith

----------------------------------------------------
This mailbox protected from junk email by MailFrontier Desktop
from MailFrontier, Inc. http://info.mailfrontier.com