W3C home > Mailing lists > Public > public-html-testsuite@w3.org > October 2012

Re: HTML Test suite coverage (partial)

From: Philippe Le Hegaret <plh@w3.org>
Date: Tue, 23 Oct 2012 08:56:40 -0400
To: James Graham <jgraham@opera.com>
Cc: public-html-testsuite@w3.org
Message-ID: <1350997000.3751.157.camel@chacal>
On Tue, 2012-10-23 at 12:40 +0200, James Graham wrote:
> On 10/23/2012 01:56 AM, Philippe Le Hegaret wrote:
> > As part of trying to get an idea of where we are, I generated a view of
> > where we have tests or not (attached). It's only partial and I'll try to
> > improve it by next week. Only covers the HTML5 spec for the moment.
> 
> Nice start :)
> 
> It would be interesting to hear what your methodology is. Does this 
> cover approved tests only, or both submitted and approved?

It's a partial covering of the submitted ones. I'm assuming that all
approved tests are also in the submission directory so I'm not looking
at those for this report.

>  Is it 
> automated or does it it involve lots of manual work still?

All automated so far. It's a bunch a quick and dirty Java code. I can
put the code in the repository if it is of interest.

> I suggest we cross-reference this with data about what is implemented in 
> browsers; the areas with the biggest delta would be obvious targets for 
> short-term testing effort. If you have some code that generates this 
> output, I could try adding caniuse.com data.

An other way is to generate this apart. As long as the data is
associated with ids in the documents, we can mash them up later.

Philippe
Received on Tuesday, 23 October 2012 12:56:46 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 23 October 2012 12:56:47 GMT