- From: Jonathan Marsh via cvs-syncmail <cvsmail@w3.org>
- Date: Tue, 16 Jan 2007 12:53:50 +0000
- To: public-ws-desc-eds@w3.org
Update of /sources/public/2002/ws/desc/test-suite
In directory hutz:/tmp/cvs-serv6742/test-suite
Modified Files:
Dashboard.html test-suite.xml
Log Message:
See http://lists.w3.org/Archives/Public/www-ws-desc/2007Jan/0122.html:
In order not to lose the few bindings that make sense under SOAP, I’ve cloned LocationTemplate-1G into LocationTemplate-2G which is an HTTP binding-only version. I twiddled a few other details to keep everything sufficiently unique (e.g. service name, whttp:location URLs, etc.)
I’ve cut the AutoRemainder, AdditionalQueryParams, and AutoQueryParams bindings from LocationTemplate-1G.
Since we’ve clarified that the {http location} is engaged on both soap-request and request-response MEPs, I cloned the remaining 4 operations and test them on the request-response MEP as well.
While doing this, I noticed some service names were not unique within the whole set of tests we’re doing, which is inconvenient for some implementations like Axis2. I updated MessageTest-2G,3G,4G service names (which should affect the component model more than the message tests.)
Also made sure queryParameterSeparater values were consistent with any query params explicitly specified in whttp:location.
Index: test-suite.xml
===================================================================
RCS file: /sources/public/2002/ws/desc/test-suite/test-suite.xml,v
retrieving revision 1.43
retrieving revision 1.44
diff -C 2 -d -r1.43 -r1.44
*** test-suite.xml 5 Jan 2007 06:14:02 -0000 1.43
--- test-suite.xml 16 Jan 2007 12:53:48 -0000 1.44
***************
*** 173,176 ****
--- 173,177 ----
<test-case id="IRI-3G" href="documents/good/IRI-3G/TestMetadata.xml"/>
<test-case id="LocationTemplate-1G" href="documents/good/LocationTemplate-1G/TestMetadata.xml"/>
+ <test-case id="LocationTemplate-2G" href="documents/good/LocationTemplate-2G/TestMetadata.xml"/>
<test-case id="MessageTest-1G" href="documents/good/MessageTest-1G/TestMetadata.xml"/>
<test-case id="MessageTest-2G" href="documents/good/MessageTest-2G/TestMetadata.xml"/>
Index: Dashboard.html
===================================================================
RCS file: /sources/public/2002/ws/desc/test-suite/Dashboard.html,v
retrieving revision 1.39
retrieving revision 1.40
diff -C 2 -d -r1.39 -r1.40
*** Dashboard.html 16 Jan 2007 09:43:39 -0000 1.39
--- Dashboard.html 16 Jan 2007 12:53:47 -0000 1.40
***************
*** 15,19 ****
.explanatory {font-size:smaller}
</style></head><body><h2>WSDL 2.0 Interop Dashboard</h2><address>Generated January 16 2007,
! 1504</address><p class="explanatory">This page summarizes the results of interop testing of the
<a href="http://www.w3.org/TR/wsdl20">WSDL 2.0 Core</a> and
<a href="http://www.w3.org/TR/wsdl20-adjuncts">WSDL 2.0 Adjuncts</a> specifications,
--- 15,19 ----
.explanatory {font-size:smaller}
</style></head><body><h2>WSDL 2.0 Interop Dashboard</h2><address>Generated January 16 2007,
! 1748</address><p class="explanatory">This page summarizes the results of interop testing of the
<a href="http://www.w3.org/TR/wsdl20">WSDL 2.0 Core</a> and
<a href="http://www.w3.org/TR/wsdl20-adjuncts">WSDL 2.0 Adjuncts</a> specifications,
***************
*** 25,29 ****
a WSDL 2.0 parser and web services engine from Canon."</p><table cellspacing="3"><tr><td class="group" colspan="4"><h3>Interop results</h3></td></tr><tr><td><div class="heading">Component Model Test Results</div></td><td><p class="explanatory">(<a href="results/Interchange.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results test the results of parsing a WSDL 2.0 document, by generating an
interchange format representing the component model in XML and comparing it against a baseline description
! of the component model.</p></td></tr><tr><td></td><td colspan="3"><table><tr><td><strong>Woden</strong></td><td><strong>WSDL XSLT</strong></td><td><strong>Canon</strong></td></tr><tr><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">70</span><img alt="93% passed" width="187" height="16" src="green.gif"><span style="position:absolute">4</span><img alt="5% failed" width="11" height="16" src="red.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">74</span><img alt="99% passed" width="197" height="16" src="green.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">72</span><img alt="96% passed" width="192" height="16" src="green.gif"><span style="position:absolute">1</span><img alt="1% failed" width="3" height="6" src="red.gif"></td></tr></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Message Exchange Test Results</div></td><td><p class="explanatory">(<a href="results-messages/Message-tests-results.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of log files of message exchanges based
! on complex WSDL 2.0 documents, with each implementation run pair-wise against the others.</p></td></tr><tr><td colspan="4"><table xmlns="http://www.w3.org/2002/ws/desc/logs/"><thead><tr><th/><th><nobr>Canon</nobr> >> <nobr>Canon</nobr></th><th><nobr>Canon</nobr> >> <nobr>WSO2 WSAS</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>Canon</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>WSO2 WSAS</nobr></th></tr></thead><tbody><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-1G">MessageTest-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">40</span><img alt="95% passed" width="143" height="16" src="green.gif"/><span style="position:absolute">2</span><img alt="5% failed" width="7" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><san style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif"/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif"/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">35</span><img alt="83% passed" width="125" height="16" src="green.gif"/><span style="position:absolute">7</span><img alt="17% failed" width="25" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-4G">MessageTest-4G</a> (SOAP12)</td><td style="border:1px solid black; pdding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">4</span><img alt="67% passed" width="100" height="16" src="green.gif"/><span style="position:absolute">2</span><img alt="33% failed" width="50" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-5G">MessageTest-5G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">12</span><img alt="100% passed" width="150" height="16" src="green.gif"/></td><td style=border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#ModuleComposition-1G">ModuleComposition-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">5</span><img alt="63% passed" width="94" height="16" src="green.gif"/><span style="position:absolute">3</span><img alt="38% failed" width="56" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18p; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#LocationTemplate-1G">LocationTemplate-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">11</span><img alt="79% passed" width="118" height="16" src="green.gif"/><span style="position:absolute">3</span><img alt="21% failed" width="32" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr>td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-2G">MessageTest-2G</a> (HTTP)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">20</span><img alt="83% passed" width="125" height="16" src="green.gif"/><span style="position:absolute">4</span><img alt="17% failed" width="25" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">14</span><img alt="58% passed" width="88" height="16" src="green.gif"/><span style="position:absolute">10</span><img alt="42% failed" width="62" height="16" src="red.gif"/></td></tr><tr<td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-3G">MessageTest-3G</a> (HTTP)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Validation Test Results</div></td><td><p class="explanatory">(<a href="results/Validation.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of validation log files generated by validating implementations consuming both good and bad documents in the test uite. Green and yellow both mean that the testcase was correctly validated, the difference being that a yellow indicates that the implementation did not correctly identify the specific assertion a "bad" testcase was designed fail on.</p></td></tr><tr><td></td><td colspan="3"><table><thead><tr><td><strong>Woden</strong></td><td><strong>Canon</strong></td></tr></thead><tbody><tr><td><div style="border:1px solid black; width:201px; height:16px; font-size:x-small; font-weight:bold"><span style="position:absolute">83</span><img alt="37.38738738738739% passed" width="74.77477477477478" height="16" src="green.gif"><span style="position:absolute">32</span><img alt="14.414414414414415% passed" width="28.82882882882883" height="16" src="yellow.gif"><span style="position:absolute">85</span><img alt="38.288288288288285% failed" width="76.57657657657657" height="16" src="red.gif"><span style="position:absolute"> (22)</span></div></td><td><div style="border:1px solid black; width:201px; height:16px; font-size:x-smal; font-weight:bold"><span style="position:absolute">82</span><img alt="36.93693693693694% passed" width="73.87387387387388" height="16" src="green.gif"><span style="position:absolute">66</span><img alt="29.72972972972973% passed" width="59.45945945945946" height="16" src="yellow.gif"><span style="position:absolute">73</span><img alt="32.88288288288289% failed" width="65.76576576576578" height="16" src="red.gif"><span style="position:absolute"> (1)</span></div></td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td class="group" colspan="4"><h3>Test Suite Completeness</h3></td></tr><tr><td><div class="heading">Assertion Coverage</div></td><td><p class="explanatory">(<a href="Assertion-coverage.html">details</a>)</p></td><td colspan="2"><p class="explanatory">Count of assertions violated by "bad" testcases, compared with the total number of assertions
identified in the specs.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">105</span><img alt="50% have coverage" width="100" height="16" src="green.gif"><span style="position:absolute">105</span><img alt="50% have no coverage" width="100" height="16" src="red.gif"></div></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Test Case Coverage</div></td><td><p class="explanatory">(<a href="Test-suite-coverage-summary.html">details</a>)</p></td><td colspan="2"><p class="explanatory">An analysis of the use of various parts of the WSDL syntax (elements, attributes, uris) in the test collection. Green indicates 4 or more occurances of the construct, yellow indicates less than 4 occurances, and red indicates zero occurances.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:xsmall; font-weight:bold; margin:0px"><span style="position:absolute">73</span><img alt="70% have good coverage" width="141" height="16" src="green.gif"><span style="position:absolute">29</span><img alt="29% have minimal coverage" width="57" height="16" src="yellow.gif"><span style="position:absolute">1</span><img alt="1% have no coverage" width="2" height="16" src="red.gif"></div></td></tr></table></body></html>
\ No newline at end of file
--- 25,29 ----
a WSDL 2.0 parser and web services engine from Canon."</p><table cellspacing="3"><tr><td class="group" colspan="4"><h3>Interop results</h3></td></tr><tr><td><div class="heading">Component Model Test Results</div></td><td><p class="explanatory">(<a href="results/Interchange.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results test the results of parsing a WSDL 2.0 document, by generating an
interchange format representing the component model in XML and comparing it against a baseline description
! of the component model.</p></td></tr><tr><td></td><td colspan="3"><table><tr><td><strong>Woden</strong></td><td><strong>WSDL XSLT</strong></td><td><strong>Canon</strong></td></tr><tr><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">67</span><img alt="88% passed" width="176" height="16" src="green.gif"><span style="position:absolute">7</span><img alt="9% failed" width="18" height="16" src="red.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">75</span><img alt="99% passed" width="197" height="16" src="green.gif"></td><td style="border:1px solid black; padding:0px; width:201px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">68</span><img alt="89% passed" width="179" height="16" src="green.gif"><span style="position:absolute">5</span><img alt="7% failed" width="13" height=16" src="red.gif"></td></tr></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Message Exchange Test Results</div></td><td><p class="explanatory">(<a href="results-messages/Message-tests-results.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of log files of message exchanges based
! on complex WSDL 2.0 documents, with each implementation run pair-wise against the others.</p></td></tr><tr><td colspan="4"><table xmlns="http://www.w3.org/2002/ws/desc/logs/"><thead><tr><th/><th><nobr>Canon</nobr> >> <nobr>Canon</nobr></th><th><nobr>Canon</nobr> >> <nobr>WSO2 WSAS</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>Canon</nobr></th><th><nobr>WSO2 WSAS</nobr> >> <nobr>WSO2 WSAS</nobr></th></tr></thead><tbody><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-1G">MessageTest-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">40</span><img alt="95% passed" width="143" height="16" src="green.gif"/><span style="position:absolute">2</span><img alt="5% failed" width="7" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><san style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif"/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">9</span><img alt="21% passed" width="32" height="16" src="green.gif"/><span style="position:absolute">33</span><img alt="79% failed" width="118" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">35</span><img alt="83% passed" width="125" height="16" src="green.gif"/><span style="position:absolute">7</span><img alt="17% failed" width="25" height="16" src="red.gif"/></td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-4G">MessageTest-4G</a> (SOAP12)</td><td style="border:1px solid black; pdding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">4</span><img alt="67% passed" width="100" height="16" src="green.gif"/><span style="position:absolute">2</span><img alt="33% failed" width="50" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-5G">MessageTest-5G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">12</span><img alt="100% passed" width="150" height="16" src="green.gif"/></td><td style=border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#ModuleComposition-1G">ModuleComposition-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">5</span><img alt="63% passed" width="94" height="16" src="green.gif"/><span style="position:absolute">3</span><img alt="38% failed" width="56" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18p; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#LocationTemplate-1G">LocationTemplate-1G</a> (SOAP12)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">7</span><img alt="44% passed" width="66" height="16" src="green.gif"/><span style="position:absolute">9</span><img alt="56% failed" width="84" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><t style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-2G">MessageTest-2G</a> (HTTP)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">20</span><img alt="83% passed" width="125" height="16" src="green.gif"/><span style="position:absolute">4</span><img alt="17% failed" width="25" height="16" src="red.gif"/></td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">14</span><img alt="58% passed" width="88" height="16" src="green.gif"/><span style="position:absolute">10</span><img alt="42% failed" width="62" height="16" src="red.gif"/></td></tr><tr><d style="font-size:smaller"><a href="results-messages/Message-tests-results.html#MessageTest-3G">MessageTest-3G</a> (HTTP)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr><tr><td style="font-size:smaller"><a href="results-messages/Message-tests-results.html#LocationTemplate-2G">LocationTemplate-2G</a> (HTTP)</td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style"border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td><td style="border:1px solid black; padding:0px; width:150px; height:18px; font-size:x-small; text-align:center"> </td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Validation Test Results</div></td><td><p class="explanatory">(<a href="results/Validation.html">details</a>)</p></td><td colspan="2"><p class="explanatory">These results represent the analysis of validation log files generated by validating implementations consuming both good and bad documents in the test suite. Green and yellow both mean that the testcase was correctly validated, the difference being that a yellow indicates that the implementation did not correctly identify the specific assertion a "bad" testcase was designed fail on.</p></td></tr><tr><td></td><td colspan="3"><table><thead><tr><td><strong>Woden</strong></td><td><strong>Canon</strong></td></tr></thead><tbody><tr><td<div style="border:1px solid black; width:201px; height:16px; font-size:x-small; font-weight:bold"><span style="position:absolute">84</span><img alt="37.66816143497758% passed" width="75.33632286995515" height="16" src="green.gif"><span style="position:absolute">32</span><img alt="14.349775784753364% passed" width="28.699551569506728" height="16" src="yellow.gif"><span style="position:absolute">84</span><img alt="37.66816143497758% failed" width="75.33632286995515" height="16" src="red.gif"><span style="position:absolute"> (23)</span></div></td><td><div style="border:1px solid black; width:201px; height:16px; font-size:x-small; font-weight:bold"><span style="position:absolute">82</span><img alt="36.771300448430495% passed" width="73.54260089686099" height="16" src="green.gif"><span style="position:absolute">66</span><img alt="29.596412556053814% passed" width="59.19282511210763" height="16" src="yellow.gif"><span style="position:absolute">73</span><img alt="32.73542600896861% failed" width="65.4708520193722" height="16" src="red.gif"><span style="position:absolute"> (2)</span></div></td></tr></tbody></table></td></tr><tr><td colspan="4"><hr></td></tr><tr><td class="group" colspan="4"><h3>Test Suite Completeness</h3></td></tr><tr><td><div class="heading">Assertion Coverage</div></td><td><p class="explanatory">(<a href="Assertion-coverage.html">details</a>)</p></td><td colspan="2"><p class="explanatory">Count of assertions violated by "bad" testcases, compared with the total number of assertions
identified in the specs.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:x-small; font-weight:bold"><span style="position:absolute">105</span><img alt="50% have coverage" width="100" height="16" src="green.gif"><span style="position:absolute">105</span><img alt="50% have no coverage" width="100" height="16" src="red.gif"></div></td></tr><tr><td colspan="4"><hr></td></tr><tr><td><div class="heading">Test Case Coverage</div></td><td><p class="explanatory">(<a href="Test-suite-coverage-summary.html">details</a>)</p></td><td colspan="2"><p class="explanatory">An analysis of the use of various parts of the WSDL syntax (elements, attributes, uris) in the test collection. Green indicates 4 or more occurances of the construct, yellow indicates less than 4 occurances, and red indicates zero occurances.</p></td></tr><tr><td></td><td colspan="3"><div style="border:1px solid black; padding:0px; width:202px; height:18px; font-size:xsmall; font-weight:bold; margin:0px"><span style="position:absolute">73</span><img alt="70% have good coverage" width="141" height="16" src="green.gif"><span style="position:absolute">29</span><img alt="29% have minimal coverage" width="57" height="16" src="yellow.gif"><span style="position:absolute">1</span><img alt="1% have no coverage" width="2" height="16" src="red.gif"></div></td></tr></table></body></html>
\ No newline at end of file
Received on Tuesday, 16 January 2007 12:54:43 UTC