Re: Problem with Firefox and WPT testing (seems to be working now)

John, 

ATVs typically put in a delay before accessing the document after a document load event to allow things to settle out (welcome to building ATs). Delays can be caused by the size of a document, operating scheduling overhead, etc. Try putting in a delay of a second or two delay before accessing the accessible object for the document after a document load and then run your test. I think you will find more consistent results. a second or two delay on these small files is forever in computer time. It should have settled out by then. 

Rich

Rich Schwerdtfeger




> On May 10, 2017, at 9:45 AM, Gunderson, Jon R <jongund@illinois.edu> wrote:
> 
> Alex and Rich,
>  
> Firefox seems to be working as expected, not sure why but I am now getting role=document and accValue=URL.
>  
> Jon
>  
>  
> From: Gunderson, Jon R [mailto:jongund@illinois.edu <mailto:jongund@illinois.edu>] 
> Sent: Tuesday, May 9, 2017 9:43 AM
> To: Rich Schwerdtfeger <richschwer@gmail.com <mailto:richschwer@gmail.com>>; Alexander Surkov <surkov.alexander@gmail.com <mailto:surkov.alexander@gmail.com>>
> Cc: ARIA Working Group <public-aria@w3.org <mailto:public-aria@w3.org>>
> Subject: Re: Problem with Firefox and WPT testing
>  
> Rich and Alex,
>  
> I have done some more testing and it sometimes returns role=document with accvalue=url and sometimes role=application and accValue=undefined.
>  
> It can also be tested using the W3C Web Platform Test Server:
> http://w3c-test.org/tools/runner/index.html <https://urldefense.proofpoint.com/v2/url?u=http-3A__w3c-2Dtest.org_tools_runner_index.html&d=DwMGaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=REZD8fc2AwufInstfW3L5jSLVS8bjZtAodDOhat7yAI&m=yiusoezyEc968ZbkgCn7GibY7eXE2NpKbNmyF2Fl5SU&s=ZT3FMRCEDiO34oOiAW8ODwP_PFez7La1iKIr0DK7ABU&e=>
>  
> Set “Run tests under path” to “/wai-aria/”.
>  
> Press “Start”
>  
> NOTE: It may take a few minutes to “load the manifest file”, but then it should start updating the client window with ARIA 1.1 test cases.
>  
> Monitor the accessible object returned from the onDocumentLoad events on the WPT client window.
>  
> Jon
>  
>  
> From: Jon Gunderson <jongund@illinois.edu <mailto:jongund@illinois.edu>>
> Date: Tuesday, May 9, 2017 at 9:35 AM
> To: Rich Schwerdtfeger <richschwer@gmail.com <mailto:richschwer@gmail.com>>, Alexander Surkov <surkov.alexander@gmail.com <mailto:surkov.alexander@gmail.com>>
> Cc: ARIA Group <public-aria@w3.org <mailto:public-aria@w3.org>>
> Subject: Re: Problem with Firefox and WPT testing
> Resent-From: ARIA Group <public-aria@w3.org <mailto:public-aria@w3.org>>
> Resent-Date: Tuesday, May 9, 2017 at 9:36 AM
>  
> Rich,
>  
> I am using WPT with local host configuration and the URL in the client address bar is also showing localhost:8000.   I seems to be working in Chrome with the ondocumentload event returning an accessible object with role=document, accName=page title and  accValue=url.   Firefox in the same configuration returns role=application, accName=page title and accValue=undefined.
>  
> Jon
>  
>  
> From: Rich Schwerdtfeger <richschwer@gmail.com <mailto:richschwer@gmail.com>>
> Date: Tuesday, May 9, 2017 at 6:21 AM
> To: Jon Gunderson <jongund@illinois.edu <mailto:jongund@illinois.edu>>, Alexander Surkov <surkov.alexander@gmail.com <mailto:surkov.alexander@gmail.com>>
> Cc: ARIA Group <public-aria@w3.org <mailto:public-aria@w3.org>>
> Subject: Re: Problem with Firefox and WPT testing
>  
> Hi Jon, 
>  
> I am guessing you are not getting a URL because you are using a local page. Alex can you confirm and can this be fixed? We are trying to complete automated aria testing. … If so, could you put in localhost: …?
>  
> Alex, is there a reason you are exposing a role of application for the web page itself? Is it coming from the Firefox application instead of the web page document?
>  
> Rich
>  
>  
> Rich Schwerdtfeger
>  
>  
> 
>  
> On May 8, 2017, at 5:18 PM, Gunderson, Jon R <jongund@illinois.edu <mailto:jongund@illinois.edu>> wrote:
>  
> I am making progress on the automated testing of MSAA+IAccessible2 foe Firefox and Chrome.
>  
> There is a problem in with Firefox and WPT.
>  
> When WPT opens a client widow and cycles through the ARIA tests, Firefox’s on document load event object identifies the role as “application” instead of “document”  and the accessible value does not contain the URL for the test, which it does for other FF web pages. 
>  
> The URL is needed by the ATTA to make sure the test cases matches up to the right results.
>  
> Joanie do you have this problem on OSX or Linux?
>  
> Is there someone we can talk to at Mozilla to see if they could make some changes or provide information on how to get the URL in this case?
>  
> Jon
>  
> P.S. Seems to be working fine with Chrome so far, the accessible object’s role is “document” and the accessible value is the URL of the test page.
>