Re: WS-Policy CR Dashboard (was ACTION-234

Asir,

Thanks for pulling this together. In general, looks good for a detail 
page. I would be interested in capturing 
the summary-level information in the actual "dashboard" in a manner such 
as used by the WSDL WG [1].
I would be more than happy to take a stab at synthisizing the summaries I 
have in mind.

In particular, I would like a summary of the percent of tests successfully 
completed by implementation, another
summary of the percent completion of the matrix of interop tests (with 
regards to other implementations) and a final
summary that indicates the percent of features that have achieved their 
exit criteria.

Paul and I have also discussed that we will need a mechanism by which 
implementation results can be 
anonymously reported (e.g. submitted in confidence to the w3 team 
contact).

[1] 
http://dev.w3.org/cvsweb/~checkout~/2002/ws/desc/test-suite/Dashboard.html

Cheers,

Christopher Ferris
STSM, Software Group Standards Strategy
email: chrisfer@us.ibm.com
blog: http://www.ibm.com/developerworks/blogs/page/chrisferris
phone: +1 508 377 9295

public-ws-policy-request@w3.org wrote on 03/12/2007 11:25:40 AM:

> 
> >ACTION-234 Provide format for recording interop results [1]
> 
> A CR dashboard (auto generated) for recording interop results and 
> tracking progress during CR is at http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/dashboard.html.
> 
> Templates and samples for reporting CR participant information and 
> interop/unit test results are available at [2]. The WG can collect 
> these information in XML format (from implementers) and auto 
> generate the dashboard.
> 
> Paul and Chris - F2F is a great opportunity to walk through the CR 
> dashboard. I request you to allocate some time for this.
> 
> Glen - a summary of available Round 3 WSDL 11 endpoints is at [3].
> 
> The CR dashboard is a work in-progress. Pending work items are:
> 
> a) Associate features to test cases
> b) Set up ANT build targets to generate summaries for Round-4-Media-
> Type, Round-4-External-Policy-Attachment-WSDL11 and Round-4-
> External-Policy-Attachment-WSDL20
> c) Fill up missing test case descriptions in Rounds.xml [4]
> 
> [1] http://www.w3.org/2005/06/tracker/wspolicy/actions/234
> [2] http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/participants/
> 
http://dev.w3.org/cvsweb/~checkout~/2006/ws/policy/interop/results/round1/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round2/WSDL11/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round2/WSDL20/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round3/WSDL11/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round3/WSDL20/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round4/mediatype/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round4/external-
> policy-attachment/WSDL11/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round4/external-
> policy-attachment/WSDL20/
> http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/round4/UDDI/
> [3] http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/dashboard.
> html#Round-3-WSDL11
> [4] http://dev.w3.
> org/cvsweb/~checkout~/2006/ws/policy/interop/results/rounds.xml
> 
> Regards,
> 
> Asir S Vedamuthu
> Microsoft Corporation
>