Action 276 (was RE: NEW ISSUE: Round4 negative tests

>ACTION-276 Asir to respond to Doug and propose scenarios
>paragraph to clarify negative test scenarios.

Thank you for a concrete proposal.

We are wondering if the test description could be simpler by dropping phrases or words such as error, action, corrective action, generation of fault, attempting to fix, invalid, etc. Here is a suggested editorial revision (no changes to content):

"7. Negative Testcases

The Round 4 Negative Test directory contains a set of non-conformant policy expressions. These are WS-Policy unit test cases. Implementations are expected to attempt to normalize these expressions and detect non-conformance. A detected non-conformance is considered to be a successful outcome."

Regards,

Asir S Vedamuthu
Microsoft Corporation


From: public-ws-policy-request@w3.org [mailto:public-ws-policy-request@w3.org] On Behalf Of Doug Davis
Sent: Wednesday, April 11, 2007 10:07 AM
To: Doug Davis
Cc: public-ws-policy@w3.org; public-ws-policy-request@w3.org
Subject: Re: NEW ISSUE: Round4 negative tests


I decided to draft up a possible solution for this issue - add a new section 7 as follows:
- - - - - - - - - - - - -
7. Negative Testcases
As part of this round of testing a set of WS-Policy expressions will be provided. Each one will be invalid in some way. Implementations will be expected to attempt to Normalize each expression and detect that there is an error.  It is beyond the scope of this document to define what action each implementation needs to take, however, a successful result will be considered to be achieved if some kind of corrective action is taken. Some possible actions might include: generation of a fault or attempting to fix the expression so it is no longer invalid.
- - - - - - - - - - - - -

thanks
-Doug
______________________________________________________
STSM  |  Web Services Architect  |  IBM Software Group
(919) 254-6905  |  IBM T/L 444-6905  |  dug@us.ibm.com<mailto:dug@us.ibm.com>

Doug Davis/Raleigh/IBM@IBMUS
Sent by: public-ws-policy-request@w3.org<mailto:public-ws-policy-request@w3.org>

04/11/2007 11:53 AM

To

"public-ws-policy@w3.org<mailto:public-ws-policy@w3.org>" <public-ws-policy@w3.org<mailto:public-ws-policy@w3.org>>

cc

Subject

NEW ISSUE: Round4 negative tests








The round4 doc [1] mentions negative tests but doesn't actually says what's involved.  We can assume that we're supposed to try to Normalize the xml files and that the engine MUST (should?) fail in some way - but it would be nice if the doc stated this so that everyone knows what "success" means.

[1] http://dev.w3.org/cvsweb/~checkout~/2006/ws/policy/interop/WS-Policy-Scenarios-Round4.doc?only_with_tag=Release-1-20070322

thanks
-Doug
______________________________________________________
STSM  |  Web Services Architect  |  IBM Software Group
(919) 254-6905  |  IBM T/L 444-6905  |  dug@us.ibm.com<mailto:dug@us.ibm.com>