WCSS test suite survey

Test suite of concern:
http://testfest.openmobilealliance.org/CSS_Content/index.html

Specification:
AFAIK the latest version is 1.1,
http://www.openmobilealliance.org/release_program/docs/Browsing/V2_2-20040609-C/OMA-WAP-WCSS-V1_1-20040609-C.pdf

Coverage
There are 358 tests. The test suite seems to be (close to) complete. I  
have not found major issues missing.

Documentation
http://testfest.openmobilealliance.org/docs/CSS_Tests_V1_1_2006_05_10.doc
The documentation is available for members only.

Test harness
The test suite consists of a listing of categories and subcategories. By  
following those, one can reach each test, implying a lot of next/back  
navigation. This can be solved more neatly by <link rel="next">. At the  
end of each test, there is a link to post results to a potential tracker  
script (as an example, it didn't work for me).

Testing
- The tests appear to hold high quality. Each test has a clear pass  
condition. The description, however, should be made much more concise.
- Some tests rely on font and color effects for those UAs which support  
them.
- Some tests rely on font (e.g. italic font) and color effects where this  
is not necessarily needed.
- Almost all tests are suiteable for mobile screens. I found only a few  
table tests which should be re-engineered for testing on small screens.

Automation
Approx. 90% of the testing doesn't require user interaction.

Public availability
The test suite is available for OMA members and for nonmembers upon a  
license agreement.

License
See availability.

-- 
Till Halbach
Quality Assurance, Opera Software (www.opera.com)

Received on Tuesday, 6 March 2007 14:00:16 UTC