Fixing tests for ReplyTo of none [was : WSO2 -> Axis issues (PLEASE READ, SPEC/TEST ISSUES)]

Hi Glen,

I'm happy to fix the suite given we've now a stable
report which has some caveats which we're able to 
present so the spec can progress [1].

So: 

 - we need to work out and make changes to the testcases [2]
 - get people to fix their implementations
 - coordinate a re-run across the board
 - fetch logs and rebuild the report.

We could do this iteratively, but it sounds like something 
best done during a pre-arranged slot?

Paul

[1] http://www.w3.org/2002/ws/addr/5/08/impl-report
[2] http://lists.w3.org/Archives/Public/public-ws-addressing-tests/2006Mar/0179.html

-----Original Message-----
From: Glen Daniels [mailto:gdaniels@sonicsoftware.com]
Sent: Wed 3/15/2006 9:16 PM
To: Downey,P,Paul,CXMA C; dims@wso2.com
Cc: mark.little@jboss.com; public-ws-addressing-tests@w3.org
Subject: RE: WSO2 -> Axis issues (PLEASE READ, SPEC/TEST ISSUES)
 
Hi Paul:

> I'm nervous messing with the report given our PR call is 
> tomorrow however fetchlogs.pl picked up:

We're not talking about "messing with the report", we're talking about
the fact that the report as it stands is incorrect, or at the least
incomplete.  This is one of the issues with getting the results via a
small set of XPath assertions... I could post logs which violate the
SOAP schema and the report would validate them as green.

* The WSO2 logs show the aforementioned problem with WSA
implementations.

* The MS->everyone logs show a) invalid SOAP (test 1170, bad MU value)
and b) invalid WSA schema (non-URI action values in 1143/1243).  Just
because most people accept these messages doesn't mean they aren't
wrong.

I don't think that brushing this stuff under the carpet is going to help
anyone, either in the short run or the long run.  On the bright side,
there are going to be NO spec changes to get these issues fixed, however
the test suite and the implementations DO need to change, IMHO.

What do others think here?

--Glen

Received on Thursday, 16 March 2006 21:42:08 UTC