Interop testing for Web Sockets [Was: Re: Call for Test Results: CR-websockets-20120920]

Hi Kris, Ken, All - what is the status and plan re Web Sockets interop 
testing?

-Thanks, Art


On 3/29/13 10:01 AM, ext Arthur Barstow wrote:
> Hi Kris, Ken, Simon, James, All,
>
> Since the RfR for Opera's WebSocket tests passed, I copied the 
> reviewed files to [approved]. I presume the totality of the approved 
> tests is sufficient to test the Web Socket CR's exit criteria [CR-EC], 
> thus I would like us to start interop testing.
>
> Kris/Ken - would you please lead this interop effort e.g. 
> consolidating data?
>
> James/Simon - can you help gather data (f.ex. run some subset of the 
> tests, run the tests on a subset of the browsers, etc.)?
>
> I would like to understand where we have good interop as well as where 
> we have issues, with the longer-term goal of knowing if we have 
> sufficient interop to move the CR to Proposed Recommendation per the 
> CR's exit criteria [CREC].
>
> For some example interop reports, see 
> <http://www.w3.org/wiki/Webapps/Interop/ProgressEvents> and 
> <http://www.w3.org/wiki/Webapps/Interop/ServerSentEvents>.
>
> -Thanks, AB
>
> [approved] <http://w3c-test.org/webapps/WebSockets/tests/approved/>
> [CREC] <http://www.w3.org/TR/2012/CR-websockets-20120920/#crec>
>
>
> -------- Original Message --------
> Subject:     RfR: WebSocket API test files from Opera; deadline March 25
> Resent-Date:     Mon, 11 Mar 2013 20:00:18 +0000
> Resent-From:     <public-webapps-testsuite@w3.org>
> Date:     Mon, 11 Mar 2013 15:59:51 -0400
> From:     ext Arthur Barstow <art.barstow@nokia.com>
> To:     public-webapps-testsuite@w3.org <public-webapps-testsuite@w3.org>
>
>
>
> This is a call for review for the WebSocket API test files from Opera:
>
> <http://w3c-test.org/webapps/WebSockets/tests/submissions/Opera/>
>
> Note: some of these files were included in an earlier RfR [1]. Below,
> James identifies those files that were in [1] but have since changed.
>
> Note: the *-1.html files in the unload-a-document directory are "helper"
> files (that are not directly run).
>
> If you have any comments, please send them to
> public-webapps-testsuite@w3.org by March 25.
>
> If you review any set of the tests and find no issues, please state that
> as a reply to this RfR (so we can get a sense of whether or not anyone
> reviewed the tests).
>
> In the absence of any comments, these tests will be considered Approved
> by the WG.
>
> -Thanks, AB
>
> [1]
> <http://lists.w3.org/Archives/Public/public-webapps-testsuite/2013Feb/0025.html> 
>
>
> -------- Original Message --------
> Subject:     Re: RfR: 32 WebSocket API test files from Opera; deadline 
> March 7
> Resent-Date:     Mon, 11 Mar 2013 13:37:39 +0000
> Resent-From:     <public-webapps-testsuite@w3.org>
> Date:     Mon, 11 Mar 2013 14:37:06 +0100
> From:     ext James Graham <jgraham@opera.com>
> To:     <public-webapps-testsuite@w3.org>
>
>
>
> On 03/11/2013 02:17 PM, Arthur Barstow wrote:
>> James, Simon - presumably the test files for the RfR that ended March 7
>> are now reviewed and considered approved unless any of them were changed
>> during the RfR period. If any of those files were changed during the
>> review, please let us which ones.
>
> if my hg-fu worked the files that changed from the set in the previous
> RfR are:
>
> WebSockets/tests/submissions/Opera/binary/002.html
> WebSockets/tests/submissions/Opera/binary/004.html
> WebSockets/tests/submissions/Opera/constructor/008.html
> WebSockets/tests/submissions/Opera/opening-handshake/002.html
>
>> Also, would you please clarify the set of additional files that need
>> review? It appears to me the files _not_ yet reviewed are:
>>
>> * 2 files in
>> <http://w3c-test.org/webapps/WebSockets/tests/submissions/Opera/constructor/ 
>>
>>  - just 013.html and 014.html
>>
>> * 7 files in
>> <http://w3c-test.org/webapps/WebSockets/tests/submissions/Opera/cookies/
>>
>> * 72 files in the subdirs of
>> <http://w3c-test.org/webapps/WebSockets/tests/submissions/Opera/interfaces/> 
>>
>>
>>
>> * 5 - 8 files in
>> <http://w3c-test.org/webapps/WebSockets/tests/submissions/Opera/unload-a-document/> 
>>
>> - should all of these files be reviewed (the use of "dash-1" in the
>> filenames is `different` so just want to make sure).
>
> The -1 files are "helper" files i.e. they are part of the test but not
> the main url that gets loaded.
>
>> After the set of files that need are clarified, I'll start a new RfR.
>
> Your list sounds right. In essence everything under
> WebSockets/tests/submissions/Opera/ is ready for review.
>
>
>
>
>
>
>
>

Received on Monday, 8 July 2013 14:05:33 UTC