RE: Validation results

Yes, so far it's by design.  Validation is considered successful if, among
the identified assertions that have been violated is the one associated with
the test case.  It's not considered unsuccessful if it identifies additional
assertions that have been violated - or multiple instances of violating a
single assertion.

 

However, I put that in place without much thought.  It would not be hard to
flag those results that weren't one-to-one matches with the identified
assertion.  Whatever makes most sense to Woden at this point.

 

Arthur, what do you think?

 

Jonathan Marsh -  <http://www.wso2.com> http://www.wso2.com -
<http://auburnmarshes.spaces.live.com> http://auburnmarshes.spaces.live.com

 

  _____  

From: Lawrence Mandel [mailto:lmandel@ca.ibm.com] 
Sent: Monday, December 04, 2006 12:11 PM
To: Jonathan Marsh
Cc: 'www-ws-desc'
Subject: RE: Validation results

 


Jonathan, 

With your most recent change I see all green on tests such as Binding-3B,
even though the test cases indicates that only assertion Binding-0057 should
be violated and Woden identifies that assertions Binding-0057 and
Binding-0055 have been violated. Is this by design? I would think assertion
Binding-0055 should be flagged with a yellow or red marker. 

Lawrence Mandel

Software Developer
IBM Rational Software
Phone: 905 - 413 - 3814   Fax: 905 - 413 - 4920
lmandel@ca.ibm.com 




"Jonathan Marsh" <jonathan@wso2.com> 
Sent by: www-ws-desc-request@w3.org 

12/04/2006 01:29 PM 


To

"'Youenn Fablet'" <youenn.fablet@crf.canon.fr> 


cc

"'www-ws-desc'" <www-ws-desc@w3.org> 


Subject

RE: Validation results

 


 

 





Good catch, I've fixed it, with more green appearing as a result.  Checked
in your results too:

http://dev.w3.org/cvsweb/~checkout~/2002/ws/desc/test-suite/results/Validati
on.html

Jonathan Marsh - http://www.wso2.com - http://auburnmarshes.spaces.live.com


> -----Original Message-----
> From: Youenn Fablet [mailto:youenn.fablet@crf.canon.fr]
> Sent: Monday, December 04, 2006 8:39 AM
> To: Jonathan Marsh; www-ws-desc
> Subject: Validation results
> 
> I have regenerated the validation results.
> I have noted that the report is not quite accurate with the good
> documents.
> They are either flagged red or yellow, while they should be either red
> or green.
> Maybe a small change in the presentation stylesheet would greatly help
> improving the overall results ;-)
> Jonathan, can you update the CVS canon validation results file with this
> one?
> Thanks,
>     Youenn
>