WICD 1.0 Testsuite and Implementation Matrix

Today, we would like to declare WICD testsuite complete.

Instead of around 75 to 85 individual test cases (our original  
estimate), we now list 127 test cases. These tests should now cover  
all testable assertions and requirements of CDRF (implicitly), WICD  
Core, WICD Mobile and WICD Full.
http://www.w3.org/2004/CDF/TestSuite/WICD_CDR_WP1/

The WICD Implementation Matrix does list five user agents at this  
time. These user agents allowed us, to verify the WICD test cases in  
large parts. At this point, this is the main purpose of the  
Implementation Matrix. We were able to successfully verify 93 of the  
127 test cases (with at least one user agent). We were not yet able,  
however, to verify the remaining 34 test cases. These tests are listed  
separately under "Testcases for which no browser implementation exists".
http://www.w3.org/2004/CDF/TestSuite/WICD_CDR_WP1/wicdmatrix.xhtml?notImplemented

We added our own experimental WebKit based "ViennaWICD" user agent to  
the matrix. It is the only agent, at this point, to implement the four  
"rightsizing" test cases: WICD Core #20-1 (Rightsizing into fixed size  
destination box), WICD Core #20-2 (Rightsizing using a percentage  
width), WICD Core #20-3 (SVG Grid with percentage width) and WICD Core  
Combined #2 (MQ device-aspect-ratio + Rightsized Child elements). The  
"ViennaWICD" agent is available for download:
http://timur.mobi/stuff/ViennaWICD-1.01.zip (4.1MB, OSX only)

We also list the Nokia N95 mobile phone in the matrix, because it  
implements a really advanced 2D focus navigation behavior. All test  
cases, that are related to "one hand operated mobile devices" (that  
is: joystick navigation, 2D focus traversal, access keys) were moved  
to a dedicated section at the bottom of the matrix. We did not test  
the desktop browsers against these test cases ("N/A").

I would like to express my deepest gratitude to Lars Piepel, Daniel  
Herzog and Melissa Steil. Who did all of the work, really. Thank you  
very much.

To summarize: The WICD testsuite (which is still in preliminary state  
until confirmed by the CDF group) is now complete. It should now be  
possible to use it as an extensible framework for the evaluation of  
upcoming WICD user agents.

Kind regards,
Timur


PS: Of course, nothing is perfect. If you feel like reporting issues,  
the following 12 test cases (from the list of the not yet verified  
test cases) should be a first look.

WICD Core #31 - 1     "Video in SVGT"
WICD Core #36 - 1     "Accesskeys in XHTML root, XHTML child and SVGT  
child"
WICD Core #36 - 2     "Accesskeys in XHTML root and hierarchical XHTML  
child"
WICD Core #36 - 3     "Accesskeys in XHTML parent overruling in SVG  
child"
WICD Core #37          "Focusable elements" (no focus traversal in SVG  
in most cases)
WICD Core #39,40,41 "Focusable types" (no focus traversal in SVG in  
most cases)
WICD Core #61          "Smil object timing"
WICD Core #68          "Deactivating adaptation  
techniques" ("handheld" outdated?)
WICD Mobile #11 - 2  "DOM L3 Event Spec Subset mouse wheel event"
WICD Mobile #11 - 3  "DOM L3 Event Spec Subset text event"
WICD Mobile #11 - 6  "DOM L3 Event Spec Subset Progress events"
WICD Mobile #11 - 5  "DOM L3 Event Spec Subset UI focus events"

Received on Wednesday, 7 November 2007 23:50:28 UTC