- From: Jonathan Marsh via cvs-syncmail <cvsmail@w3.org>
- Date: Wed, 10 Jan 2007 21:42:40 +0000
- To: public-ws-desc-eds@w3.org
Update of /sources/public/2002/ws/desc/test-suite In directory hutz:/tmp/cvs-serv26337/test-suite Modified Files: dashboard.xsl Dashboard.html Log Message: Regenerated results. Updated dashboard with more explanatory text. Index: dashboard.xsl =================================================================== RCS file: /sources/public/2002/ws/desc/test-suite/dashboard.xsl,v retrieving revision 1.5 retrieving revision 1.6 diff -C 2 -d -r1.5 -r1.6 *** dashboard.xsl 5 Jan 2007 01:20:58 -0000 1.5 --- dashboard.xsl 10 Jan 2007 21:42:38 -0000 1.6 *************** *** 53,56 **** --- 53,59 ---- <a href="http://dev.w3.org/cvsweb/~checkout~/2002/ws/desc/test-suite/index.html">Test Suite</a> is also measured.</p> + <p class="explanatory">The interop testing is based on implementations from <a href="http://incubator.apache.org/woden/">Apache Woden</a> (a WSDL 2.0 parser), + <a href="http://www.wso2.com/products/wsas/">WSO2 WSAS</a> (a web services engine that uses Woden and is built on <a href="http://ws.apache.org/axis2/">Apache Axis2</a>) and + a WSDL 2.0 parser and web services engine from Canon."</p> <table cellspacing="3"> <tr> Index: Dashboard.html =================================================================== RCS file: /sources/public/2002/ws/desc/test-suite/Dashboard.html,v retrieving revision 1.35 retrieving revision 1.36 diff -C 2 -d -r1.35 -r1.36 *** Dashboard.html 9 Jan 2007 00:01:35 -0000 1.35 --- Dashboard.html 10 Jan 2007 21:42:38 -0000 1.36 *************** *** 14,19 **** .heading {font-weight:bold; white-space: nowrap} .explanatory {font-size:smaller} ! </style></head><body><h2>WSDL 2.0 Interop Dashboard</h2><address>Generated January 8 2007, ! 1553</address><p class="explanatory">This page summarizes the results of interop testing of the <a href="http://www.w3.org/TR/wsdl20">WSDL 2.0 Core</a> and <a href="http://www.w3.org/TR/wsdl20-adjuncts">WSDL 2.0 Adjuncts</a> specifications, --- 14,19 ---- .heading {font-weight:bold; white-space: nowrap} .explanatory {font-size:smaller} ! </style></head><body><h2>WSDL 2.0 Interop Dashboard</h2><address>Generated January 10 2007, ! 1338</address><p class="explanatory">This page summarizes the results of interop testing of the <a href="http://www.w3.org/TR/wsdl20">WSDL 2.0 Core</a> and <a href="http://www.w3.org/TR/wsdl20-adjuncts">WSDL 2.0 Adjuncts</a> specifications, *************** *** 21,27 **** The completeness of the <a href="http://dev.w3.org/cvsweb/~checkout~/2002/ws/desc/test-suite/index.html">Test Suite</a> ! is also measured.</p><table cellspacing="3"><tr><td class="group" colspan="4"><h3>Interop results</h3></td></tr><tr><td><div class="heading">Component Model Test Results</div></td><td><p class="explanatory">(<a href="results/Interchange.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results test the results of parsing a WSDL 2.0 document, by generating an interchange format representing the component model in XML and comparing it against a baseline description of the component model.</p></td></tr><tr><td></td><td colspan="3"><table><tr><td><strong>Woden</strong></td><td><strong>WSDL XSLT</strong></td><td><strong>Canon</strong></td></tr><tr><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">69</span><img alt="92% passed" width="184" height="16" src="green.gif"><span style="position:absolute">5</span><img alt="7% failed" width="13" height="16" src="red.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">74</span><img alt="99% passed" width="197" height="16" src="green.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">67</span><img alt="89% passed" width="179" height="16" src="green.gif"><span style="position:absolute">6</span><img alt="8% failed" width="16" height=16" src="red.gif"></td></tr></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Message Exchange Test Results</div></td><td><p class="explanatory">(<a href="results-messages/Message-tests-results.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of log files of message exchanges based ! on complex WSDL 2.0 documents, with each implementation run pair-wise against the others.</p></td></tr><tr><td colspan="4"><table xmlns="http://www.w3.org/2002/ws/desc/logs/"><thead><tr><th/><th><nobr>Canon</nobr> >> <nobr>Canon</nobr></th><th><nobr>Canon</nobr> >> <nobr>WSO2 WSAS</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>Canon</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>WSO2 WSAS</nobr></th></tr></thead><tbody><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-1G">MessageTest-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">12</span><img alt="29% passed" width="43" height="16" src="green.gif"/><span style="position:absolute">30</span><img alt="71% failed" width="107" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"<span style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif"/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif"/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">8</span><img alt="19% passed" width="29" height="16" src="green.gif"/><span style="position:absolute">34</span><img alt="81% failed" width="121" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-4G">MessageTest-4G</a> (SOAP12)</td><td style="border:1px solid black padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">3</span><img alt="50% passed" width="75" height="16" src="green.gif"/><span style="position:absolute">3</span><img alt="50% failed" width="75" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-5G">MessageTest-5G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">7</span><img alt="58% passed" width="88" height="16" src="green.gif"/><span style="position:absolute">5</span><img alt="42% failed" width="62" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#ModuleComposition-1G">ModuleComposition-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="posiion:absolute">5</span><img alt="63% passed" width="94" height="16" src="green.gif"/><span style="position:absolute">3</span><img alt="38% failed" width="56" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#LocationTemplate-1G">LocationTemplate-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">7</span><img alt="50% passed" width="75" height="16" src="green.gif"/><span style="position:absolute">7</span><img alt="50% failed" width="75" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-2G">MessageTest-2G</a> (HTTP)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">16</span><img alt="67% passed" width="100" height="16" src="green.gif"/><span style=position:absolute">8</span><img alt="33% failed" width="50" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-3G">MessageTest-3G</a> (HTTP)</td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Validation Test Results</div></td><td><p class="explanatory">(<a href="results/Validation.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of validation log files generated by validating implementations consuming both good and bad documents in the test suite. Green and yellow both mean that the testcase was correctly validated, the difference being that a yellow indicates that the implementation did not correctly identify the specific assertion a "bad" testcase was designed fail on.</p></td></tr><tr><td></td><td colspan="3"><table><thead><tr><td><strong>Woden</strong></td><td><strong>Canon</strong></td></tr></thead><tbody><tr><td><div tyle="border:1px solid black; width:201px; height:16px; font-size:x-small; font-weight:bold"><span style="position:absolute">83</span><img alt="37.38738738738739% passed" width="74.77477477477478" height="16" src="green.gif"><span style="position:absolute">32</span><img alt="14.414414414414415% passed" width="28.82882882882883" height="16" src="yellow.gif"><span style="position:absolute">85</span><img alt="38.288288288288285% failed" width="76.57657657657657" height="16" src="red.gif"><span style="position:absolute"> (22)</span></div></td><td><div style="border:1px solid black; width:201px; height:16px; font-size:x-small; font-weight:bold"><span style="position:absolute">82</span><img alt="36.93693693693694% passed" width="73.87387387387388" height="16" src="green.gif"><span style="position:absolute">66</span><img alt="29.72972972972973% passed" width="59.45945945945946" height="16" src="yellow.gif"><span style="position:absolute">73</span><img alt="32.88288288288289% failed" width="65.76576576576578" eight="16" src="red.gif"><span style="position:absolute"> (1)</span></div></td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td class="group" colspan="4"><h3>Test Suite Completeness</h3></td></tr><tr><td><div class="heading">Assertion Coverage</div></td><td><p class="explanatory">(<a href="Assertion-coverage.html">details</a>)</p></td><td colspan="2"><p class="explanatory">Count of assertions violated by "bad" testcases, compared with the total number of assertions identified in the specs.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">105</span><img alt="50% have coverage" width="100" height="16" src="green.gif"><span style="position:absolute">105</span><img alt="50% have no coverage" width="100" height="16" src="red.gif"></div></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Test Case Coverage</div></td><td><p class="explanatory">(<a href="Test-suite-coverage-summary.html">details</a>)</p></td><td colspan="2"><p class="explanatory">An analysis of the use of various parts of the WSDL syntax (elements, attributes, uris) in the test collection. Green indicates 4 or more occurances of the construct, yellow indicates less than 4 occurances, and red indicates zero occurances.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:xsmall; font-weight:bold; margin:0px"><span style="position:absolute">73</span><img alt="70% have good coverage" width="141" height="16" src="green.gif"><span style="position:absolute">29</span><img alt="29% have minimal coverage" width="57" height="16" src="yellow.gif"><span style="position:absolute">1</span><img alt="1% have no coverage" width="2" height="16" src="red.gif"></div></td></tr></table></body></html> \ No newline at end of file --- 21,29 ---- The completeness of the <a href="http://dev.w3.org/cvsweb/~checkout~/2002/ws/desc/test-suite/index.html">Test Suite</a> ! is also measured.</p><p class="explanatory">The interop testing is based on implementations from <a href="http://incubator.apache.org/woden/">Apache Woden</a> (a WSDL 2.0 parser), ! <a href="http://www.wso2.com/products/wsas/">WSO2 WSAS</a> (a web services engine that uses Woden and is built on <a href="http://ws.apache.org/axis2/">Apache Axis2</a>) and ! a WSDL 2.0 parser and web services engine from Canon."</p><table cellspacing="3"><tr><td class="group" colspan="4"><h3>Interop results</h3></td></tr><tr><td><div class="heading">Component Model Test Results</div></td><td><p class="explanatory">(<a href="results/Interchange.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results test the results of parsing a WSDL 2.0 document, by generating an interchange format representing the component model in XML and comparing it against a baseline description of the component model.</p></td></tr><tr><td></td><td colspan="3"><table><tr><td><strong>Woden</strong></td><td><strong>WSDL XSLT</strong></td><td><strong>Canon</strong></td></tr><tr><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">69</span><img alt="92% passed" width="184" height="16" src="green.gif"><span style="position:absolute">5</span><img alt="7% failed" width="13" height="16" src="red.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">74</span><img alt="99% passed" width="197" height="16" src="green.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">67</span><img alt="89% passed" width="179" height="16" src="green.gif"><span style="position:absolute">6</span><img alt="8% failed" width="16" height=16" src="red.gif"></td></tr></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Message Exchange Test Results</div></td><td><p class="explanatory">(<a href="results-messages/Message-tests-results.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of log files of message exchanges based ! on complex WSDL 2.0 documents, with each implementation run pair-wise against the others.</p></td></tr><tr><td colspan="4"><table xmlns="http://www.w3.org/2002/ws/desc/logs/"><thead><tr><th/><th><nobr>Canon</nobr> >> <nobr>Canon</nobr></th><th><nobr>Canon</nobr> >> <nobr>WSO2 WSAS</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>Canon</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>WSO2 WSAS</nobr></th></tr></thead><tbody><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-1G">MessageTest-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">42</span><img alt="100% passed" width="150" height="16" src="green.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif"/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">8</span><img alt="19% passed" width="29" height="16" src="green.gif"/><span style="position:absolute">34</span><img alt="81% failed" width="121" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-4G">MessageTest-4G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:bsolute">6</span><img alt="100% passed" width="150" height="16" src="green.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-5G">MessageTest-5G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">12</span><img alt="100% passed" width="150" height="16" src="green.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#ModuleComposition-1G">ModuleComposition-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">5</span><img alt="63% passed" width="94" height="16" src="green.gif"/><span style="position:absolute">3</span><img alt="38% failed" width="56" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#LocationTemplte-1G">LocationTemplate-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">11</span><img alt="79% passed" width="118" height="16" src="green.gif"/><span style="position:absolute">3</span><img alt="21% failed" width="32" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-2G">MessageTest-2G</a> (HTTP)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">22</span><img alt="92% passed" width="138" height="16" src="green.gif"/><span style="position:absolute">2</span><img alt="8% failed" width="13" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-3G">MessageTest-3G</a> (HTTP)</td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></t><tr><td><div class="heading">Validation Test Results</div></td><td><p class="explanatory">(<a href="results/Validation.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of validation log files generated by validating implementations consuming both good and bad documents in the test suite. Green and yellow both mean that the testcase was correctly validated, the difference being that a yellow indicates that the implementation did not correctly identify the specific assertion a "bad" testcase was designed fail on.</p></td></tr><tr><td></td><td colspan="3"><table><thead><tr><td><strong>Woden</strong></td><td><strong>Canon</strong></td></tr></thead><tbody><tr><td><div style="border:1px solid black; width:201px; height:16px; font-size:x-small; font-weight:bold"><span style="position:absolute">83</span><img alt="37.38738738738739% passed" width="74.77477477477478" height="16" src="green.gif"><span style="position:absolute">32</span><img alt="14.41441441441441% passed" width="28.82882882882883" height="16" src="yellow.gif"><span style="position:absolute">85</span><img alt="38.288288288288285% failed" width="76.57657657657657" height="16" src="red.gif"><span style="position:absolute"> (22)</span></div></td><td><div style="border:1px solid black; width:201px; height:16px; font-size:x-small; font-weight:bold"><span style="position:absolute">82</span><img alt="36.93693693693694% passed" width="73.87387387387388" height="16" src="green.gif"><span style="position:absolute">66</span><img alt="29.72972972972973% passed" width="59.45945945945946" height="16" src="yellow.gif"><span style="position:absolute">73</span><img alt="32.88288288288289% failed" width="65.76576576576578" height="16" src="red.gif"><span style="position:absolute"> (1)</span></div></td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td class="group" colspan="4"><h3>Test Suite Completeness</h3></td></tr><tr><td><div class="heading">Assertion Coverage</div></td><td><p clas="explanatory">(<a href="Assertion-coverage.html">details</a>)</p></td><td colspan="2"><p class="explanatory">Count of assertions violated by "bad" testcases, compared with the total number of assertions identified in the specs.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">105</span><img alt="50% have coverage" width="100" height="16" src="green.gif"><span style="position:absolute">105</span><img alt="50% have no coverage" width="100" height="16" src="red.gif"></div></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Test Case Coverage</div></td><td><p class="explanatory">(<a href="Test-suite-coverage-summary.html">details</a>)</p></td><td colspan="2"><p class="explanatory">An analysis of the use of various parts of the WSDL syntax (elements, attributes, uris) in the test collection. Green indicates 4 or more occurances of the construct, yellow indicates less than 4 occurances, and red indicates zero occurances.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:xsmall; font-weight:bold; margin:0px"><span style="position:absolute">73</span><img alt="70% have good coverage" width="141" height="16" src="green.gif"><span style="position:absolute">29</span><img alt="29% have minimal coverage" width="57" height="16" src="yellow.gif"><span style="position:absolute">1</span><img alt="1% have no coverage" width="2" height="16" src="red.gif"></div></td></tr></table></body></html> \ No newline at end of file
Received on Wednesday, 10 January 2007 21:42:52 UTC