Re: Action 276 (was RE: NEW ISSUE: Round4 negative tests

Seems reasonable to me.

thanks
-Doug
______________________________________________________
STSM  |  Web Services Architect  |  IBM Software Group
(919) 254-6905  |  IBM T/L 444-6905  |  dug@us.ibm.com



Asir Vedamuthu <asirveda@microsoft.com> 
04/18/2007 11:06 AM

To
Doug Davis/Raleigh/IBM@IBMUS, "public-ws-policy@w3.org" 
<public-ws-policy@w3.org>
cc

Subject
Action 276 (was RE: NEW ISSUE: Round4 negative tests






>ACTION-276 Asir to respond to Doug and propose scenarios 
>paragraph to clarify negative test scenarios.
 
Thank you for a concrete proposal.
 
We are wondering if the test description could be simpler by dropping 
phrases or words such as error, action, corrective action, generation of 
fault, attempting to fix, invalid, etc. Here is a suggested editorial 
revision (no changes to content):
 
?7. Negative Testcases
 
The Round 4 Negative Test directory contains a set of non-conformant 
policy expressions. These are WS-Policy unit test cases. Implementations 
are expected to attempt to normalize these expressions and detect 
non-conformance. A detected non-conformance is considered to be a 
successful outcome.?
 
Regards,
 
Asir S Vedamuthu
Microsoft Corporation
 
 
From: public-ws-policy-request@w3.org 
[mailto:public-ws-policy-request@w3.org] On Behalf Of Doug Davis
Sent: Wednesday, April 11, 2007 10:07 AM
To: Doug Davis
Cc: public-ws-policy@w3.org; public-ws-policy-request@w3.org
Subject: Re: NEW ISSUE: Round4 negative tests
 

I decided to draft up a possible solution for this issue - add a new 
section 7 as follows: 
- - - - - - - - - - - - - 
7. Negative Testcases 
As part of this round of testing a set of WS-Policy expressions will be 
provided. Each one will be invalid in some way. Implementations will be 
expected to attempt to Normalize each expression and detect that there is 
an error.  It is beyond the scope of this document to define what action 
each implementation needs to take, however, a successful result will be 
considered to be achieved if some kind of corrective action is taken. Some 
possible actions might include: generation of a fault or attempting to fix 
the expression so it is no longer invalid. 
- - - - - - - - - - - - - 

thanks
-Doug
______________________________________________________
STSM  |  Web Services Architect  |  IBM Software Group
(919) 254-6905  |  IBM T/L 444-6905  |  dug@us.ibm.com 


Doug Davis/Raleigh/IBM@IBMUS 
Sent by: public-ws-policy-request@w3.org 
04/11/2007 11:53 AM 


To
"public-ws-policy@w3.org" <public-ws-policy@w3.org> 
cc

Subject
NEW ISSUE: Round4 negative tests
 









The round4 doc [1] mentions negative tests but doesn't actually says 
what's involved.  We can assume that we're supposed to try to Normalize 
the xml files and that the engine MUST (should?) fail in some way - but it 
would be nice if the doc stated this so that everyone knows what "success" 
means. 

[1] 
http://dev.w3.org/cvsweb/~checkout~/2006/ws/policy/interop/WS-Policy-Scenarios-Round4.doc?only_with_tag=Release-1-20070322 


thanks
-Doug
______________________________________________________
STSM  |  Web Services Architect  |  IBM Software Group
(919) 254-6905  |  IBM T/L 444-6905  |  dug@us.ibm.com