RE: Fwd: ACTION-681: Ask Tina to remove the IE column from the SSE implementation report (Web Applications Working Group)

Regarding to SSE test report http://www.w3.org/wiki/Webapps/Interop/ServerSentEvents , my summary of SSE failure analysis below:

1. eventsource-close.htm: the readyState return CONNECTING instead of CLOSE on Firefox. Firefox's implementation bug. 

2. eventsource-constructor-url-bogus.htm, shared-worker/eventsource-constructor-url-bogus.htm: instead of throw an exception, Chrome kept connecting the invalid URL. Chrome's implementation bug. 

3. eventsource-constructor-url-multi-window.htm: Chrome/Firefox/Opera throw assertion: assert_unreached: Reached unreachable code. Looks like an implementation bug for all browsers.

4. eventsource-cross-origin.htm: doCORS(redirect.php) timeout on Chrome and Firefox. Chrome doesn't remember the new URL when redirecting the web page, so implementation bug. Firefox's redirecting process always interrupted while the page was loading, implementation bug too.

5. format-bom-2.htm: Event stream parse failure on Firefox. Firefox's implementation bug.

6. format-comments.htm, format-data-before-final-empty-line.htm, format-field-data.htm, format-null-character.html and format-field-parsing.htm: Event stream parse failure on Opera. Opera's implementation bugs.

7. format-field-retry-bogus.htm, format-field-retry.htm: default duration (3000) of test harness timeout is too short to check the retry function, so set the timeout to 10000. Test case bug. Patch attached.

8. format-utf-8.htm: both Firefox and Opera parse the event stream in windows-1252 format instead of utf-8. Implementation bug.

9. request-status-error.htm: HTTP status: 204, 205, readyState should be CLOSED, but got CONNECTING; HTTP status: 210, 299, go to onmessage() but onerror() instead. Firefox's implementation bug.

10. dedicated-worker/eventsource-close.htm: Firefox throw ReferenceError: EventSource is not defined expected true got false. Seems Firefox doesn't support dedicated worker defining EventSource. Anybody confirm this, please? If so, I will change the test result to N/A.

11. shared-worker/eventsource-close.htm: Firefox throw error: SharedWorker is not defined. Seems Firefox doesn't support shared worker defining EventSource. Anybody confirm this, please? If so, I will change the test result to N/A.

12. shared-worker/eventsource-constructor-non-same-origin.htm: the readyState is CONNECTING instead of CLOSED on Chrome. Chrome's implementation bug

All - Please feel free to drop your comments or correct me if those are not browser's implementation bugs but limitations (test result should be N/A instead of Fail). 

Tina will submit the implementation bug to Bugzilla before this weekend.

Thanks,
Tina

-----Original Message-----
From: Arthur Barstow [mailto:art.barstow@nokia.com] 
Sent: Tuesday, April 30, 2013 8:12 PM
To: Zhao, Tina
Cc: public-webapps-testsuite@w3.or
Subject: Re: Fwd: ACTION-681: Ask Tina to remove the IE column from the SSE implementation report (Web Applications Working Group)

On 4/27/13 9:35 AM, ext Arthur Barstow wrote:
> Hi Tina - during WebApps' April 25 meeting, Adrian proposed IE be 
> removed from the SSE implementation report [SSE] and I agreed to ask 
> you to please do so.
>
> For more information about that discussion see 
> <http://www.w3.org/2013/04/25-webapps-minutes.html#item03>.

Tina - FYI, I went ahead and removed the IE data from the SSE Interop Report.

Do you have some time to investigate some of the "pervasive failures" 
i.e. those tests where we do not have at least two Passes (e.g. 3 Fails,
3 Timeouts, 2 Fails, etc.)? It would be good to note if the failures are test case bugs, implementation bugs (including link to bug), spec bugs, etc. (See the ProgressEvents Interop Report where some of this extra info is included <http://www.w3.org/wiki/Webapps/Interop/ProgressEvents>.)

-Thanks, AB

> -Thanks, Art
>
> [SSE] <http://www.w3.org/wiki/Webapps/Interop/ServerSentEvents>
>
> -------- Original Message --------
> Subject:     ACTION-681: Ask Tina to remove the IE column from the SSE 
> implementation report (Web Applications Working Group)
> Date:     Thu, 25 Apr 2013 17:07:43 +0000
> From:     ext Web Applications Working Group Issue Tracker 
> <sysbot+tracker@w3.org>
> Reply-To:     Web Applications Working Group <public-webapps@w3.org>
> To:     <art.barstow@nokia.com>
>
>
> ACTION-681: Ask Tina to remove the IE column from the SSE 
> implementation report (Web Applications Working Group)