Re: [agenda] Next week face to face meeting

Hi Allen,

Le mardi 16 janvier 2007 à 15:43 -0800, Allen Wang a écrit :
> As a member new to W3C, I would really like to know typical testing 
> methodologies and tools that are used in W3C, particually those that are 
> likely to be used in the MWI Test Suites. Is this covered in "W3C and 
> Test Suites " topic in the agenda?

It is something that I am indeed planning to discuss during next week
meeting, but let me introduce that topic in this message.

First, most of the testing efforts done at W3C are done by W3C Working
Groups that develop specifications; in other words, the same people that
write spec write the tests.

The inconvenient is that these tests are not necessarily developed by
tests specialists, but with the advantage that the spec writers are the
most likely to know what the spec means and are in position to fix the
spec if the tests show something is wrong with it.

Test Suites at W3C vary greatly in their quality, dimensions and
packaging; some tests suites are developed to demonstrate
interoperability (as the W3C process suggests to do for the so called
"Candidate Recommendation" phase), some are developed purely to find
defects in the specification and/or to help develop the specification
(with a test-driven development approach), and some (few) are full
conformance tests suites with a broad coverage of the spec, a complete
test harness, etc.

Most if not all of these tests suites are linked from the QA Matrix
document:
http://www.w3.org/QA/TheMatrix

The ones that would be relevant to the MWI would be at least the
following ones:
* SVG Tiny tests part of the SVG 1.1 test suite at
http://www.w3.org/Graphics/SVG/Test/20061213/
* CSS MP test suite
http://www.w3.org/Style/CSS/Test/Mobile/1.0/current/
* WICD Mobile
http://www.w3.org/2004/CDF/Group/TestSuite/WICD_CDR_WP1/index.xhtml

FWIW, I don't think any of these test suites can be called complete or
final.

The OMA has also been working on tests suites for XHTML MP and WCSS that
should be made available publicly in the upcoming weeks and that would
be relevant to our work.

If you explore these links, you'll see that these test suites are more
or less packaged or documented.

I think that one of the useful output of this group would be a
comprehensive survey of the existing tests suites, annotated with their
estimated coverage of the specification, their availabilities (incl.
licensing), etc.

A further option would be to contribute additional tests to these,
and/or to help package them together to make it easier for user agents
developer to integrate them in their development environment.

Hope this helps, and let me know if you have any further question.

Dom

Received on Wednesday, 17 January 2007 14:42:02 UTC