Re: [widgets] Test suite full coverage of mandatory aspects in the P&C spec, was Re: OMTP BONDI Reference Implementation fully compliant against mandatory P&C tests

Hi Marcos,

The latest P&C test results for Apache Wookie (incubating) are:

165 tests
16 ignored
17 failures
132 passes

Failed: dc,d4,an,co,za,bv,rd,b2, ao,cp,cj,af,e8,bl,bm,bn,zz (though  
the last four test cases may be in error; see previous email)
Ignored (not automatically tested - doesn't indicate failure): ds, e4,  
e5, e6, e7, z1, z2, e1, df, dr, d5, dt, dg, d6, e2, e3

Is there a particular format you need the submission of test results  
to be in?

S

On 28 Nov 2009, at 22:36, Marcos Caceres wrote:

> Hi,
>
> On Sat, Nov 28, 2009 at 9:05 PM, David Rogers  
> <david.rogers@omtp.org> wrote:
>> Dear all,
>>
>> I am very pleased to be able to announce that OMTP's BONDI Reference
>> Implementation for Windows Mobile is now fully compliant to the 165
>> mandatory tests available for the W3C Widgets 1.0: Packaging and
>> Configuration specification (proposed for CR #2). The test results  
>> can be
>> found here:
>> http://samaxes.svn.beanstalkapp.com/widgets_compatibility_matrix/trunk/index.html
>
> Congrats to the BONDI team :)
>
>> Many thanks to Toby Ealden, Christian Breitschwerdt and Marcos  
>> Caceres for
>> their outstanding efforts on this. We look forward to working with  
>> you all
>> on having another interoperable implementation to help achieve full  
>> release
>> of the specification.
>
> Just wanted to add that last Friday I added the last remaining tests
> to give us full coverage of all the MUST assertions in the P&C test
> suite. There may be some tests we need to add in the future, but, as
> editor, I am generally satisfied with the level of coverage we
> currently have.
>
> As noted in another email [2], we still need to add the optional tests
> to allow us to progress to PR (as requested by the Director of the
> W3C... again, any help with these tests is greatly appreciated).
>
> I am hopeful that other implementers will work with the WG to achieve
> interoperability across the widget specs by providing us with test
> suite results and means of verifying those results (and helping us
> improve the test suite). I'll be moving the implementation report [1]
> to the W3C on Monday (and I'll add the Widgeon tests).
>
> Also, Opera has released it's first set of test results for our
> internal implementation currently as part of [1]. We have no date yet
> as to when this implementation will be publicly available, however.
>
> Kind regards,
> Marcos
>
> [1] http://samaxes.svn.beanstalkapp.com/widgets_compatibility_matrix/trunk/index.html
> [2] http://lists.w3.org/Archives/Public/public-webapps/2009OctDec/0998.html
>
> -- 
> Marcos Caceres
> http://datadriven.com.au
>