Re: Initial resultsfor WOFF user agent testing

Thanks for assembling this, Chris.

WRT the metadata-related tests, it's understood that a UA can "pass" from a spec conformance POV if it simply does nothing with the metadata.

However, I wonder if it would be more helpful if the results made a distinction between "pass by ignoring" and "pass by appropriate display", so that we have a better picture of what is actually being implemented and tested.

Perhaps there could be a classification such as "not applicable", distinct from "pass", for metadata-display tests in relation to UAs that do not implement this (optional) feature?

JK

On 12 Sep 2011, at 22:50, Chris Lilley wrote:

> Hello,
> 
> 
> The User Agent part of the WOFF test suite has now been imported into the W3C test framework. Tested:
> 
> - Firefox 7/winxp
> - Firefox9x1/win7
> - IE9/win7
> - IE10 platformpreview/win7
> - SRW Iron(Webkit 13)/winxp
> - Opera 11.50/winxp
> 
> Still to test:
> 
> - Safari/OsX
> - Konqueror/some linux
> - PrinceXML(xhtmltopdf)/winxp
> 
> Results at link below. Note that Firefox7 was tested with a woff metadata displaying plugin; and that plugin does not refuse to display invalid metadata (hence the increased number of failures):
> 
> http://w3c-test.org/framework/results/woff-ua/
> 
> Results are aggregated by rendering engine- gecko for Firefox,Webkit for Iron (and Safari),Presto for Opera, Trident for IE.
> 
> We still need one other woff-meta-displaying implementation to test.
> 
> Some failures due to not checking for excess padding or for overlapping tables (hope we can convince implementors to fix rapidly)
> 
> Ignore the part in the implementation report that says we met the CR exit criteria already. Somehow the system thinks all the tests are optional, I need to fix that.
> 
> Also almost all tests are missing a link to the chapter, so 'sort tests by chapter' and 'test a chapter' do not work currently.
> 
> -- 
> Chris Lilley   Technical Director, Interaction Domain                 
> W3C Graphics Activity Lead, Fonts Activity Lead
> Co-Chair, W3C Hypertext CG
> Member, CSS, WebFonts, SVG Working Groups
> 
>

Received on Tuesday, 13 September 2011 06:45:11 UTC