Re: [testtwf-shenzhen] Need your input: Writing Webapps tests at TestTWF

On 9/5/13 9:37 PM, ext Rebecca Hauck wrote:
> Hi Webapps-testers,
>
> We're kicking off the planning for the next Test the Web Forward 
> event, which will be part of TPAC this year, held on Saturday, 
> November 9 at the same conference center, the Wuzhou Guest House. As 
> we develop the program, we're trying something different and reaching 
> out to all of the people in the working groups who have an active 
> interest and knowledge of the test suites.  We've created a mailing 
> list for these discussions: public-testtwf-planning@w3.org 
> <mailto:public-testtwf-planning@w3.org>.  If you respond to this 
> thread, feel free to drop the –testsuite list from the To: line to if 
> you'd like to transfer conversations to the new planning list.
>
> We'd love your input!
>
>   * Which Webapps specs need the most love right now?
>

Hi Rebecca, All - thanks very much for your e-mail!

As to your question, it depends on what you mean by `love` in this 
context ;-).

As one can see from scanning the Testing column of WebApps' status page 
<http://www.w3.org/2008/webapps/wiki/PubStatus>, there are many many 
testing related `opportunities`. I think the following specs/tasks are 
the `higher` priorities ...

* WebIDL - we need someone to Review Cameron's tests 
<http://w3c-test.org/web-platform-tests/submissions/271/WebIDL/tests/submissions/heycam/> 
(aka <https://github.com/w3c/web-platform-tests/pull/271>).

The lack of an approved test suite is one reason WebIDL is blocked from 
advancing to Proposed Recommendation and the lack of a PR is blocking 
other specs that have a normative reference for WebIDL. If test case 
review isn't within TTF's scope, that's unfortunate (albeit 
understandable) but if TTWF can help here (even if only some subset of 
tests are reviewed), we would greatly appreciate it.

* IndexedDB - we have several `submissions` that need Review:

1. Microsoft 
<http://w3c-test.org/web-platform-tests/master/IndexedDB/submissions/Microsoft/>. 
This is PR <https://github.com/w3c/web-platform-tests/pull/64>.

2. Ms2ger 
<http://w3c-test.org/web-platform-tests/master/IndexedDB/submissions/Ms2ger/>. 
This is PR <https://github.com/w3c/web-platform-tests/pull/65>.

3. Opera 
<http://w3c-test.org/web-platform-tests/master/IndexedDB/submissions/Opera/>. 
This is PR <https://github.com/w3c/web-platform-tests/pull/63>.

4. TTWF-Paris 
<http://w3c-test.org/web-platform-tests/master/IndexedDB/submissions/TestTWF_Paris/>. 
It appears these are PRs #66-#69

(See also this tread 
<http://lists.w3.org/Archives/Public/public-webapps-testsuite/2013Jul/0000.html>.)

* File API - this spec should soon enter Last Call Working Draft. It has 
some submissions 
<http://w3c-test.org/web-platform-tests/master/FileAPI/tests/submissions/> 
(PRs #53 and #54), at least six PRs from TTWF-Shanghai and PubStatus 
says it is "~20% complete". KrisK is the spec's Test Facilitator so it 
would be good to get his input re the priority tasks and plans for this 
test suite. For example, it's not clear if the existing coverage is 
reasonably good, where are the holes, etc.

* DOM3 Events (moving toward a new LCWD) - Gary and Alex are the Test 
Facilitators and PubStatus says this test suite is "75% complete". Gary, 
Alex - what is the status of this test suite? If there are some testing 
gaps you think the TTWF people should address, please let us know the 
details.

* DOM (4/Core) - Aryeh is the Test Facilitator and Ms2ger has been 
active. PubStatus says this test suite is "50% complete" [I don't recall 
the provenance of that number ;-)]. Aryeh, Ms2ger - what is the status 
of this test suite? If there are some testing gaps you think the TTWF 
people should address, please let us know the details.

Lastly, although WebApps will accept tests for any of its specs, I think 
our coverage for the specs listed in the following document is what I 
will call `reasonable as is` <http://www.w3.org/wiki/Webapps/Interop>.

If others within WebApps have feedback, please speak up.

-Thanks, ArtB


>   * Are you planning on being at TPAC and able to come support new
>     test authors? (If we've already contacted you individually, you
>     can skip this part – but still welcome your input on the rest of this)
>   * If you aren't able to attend, are you in a timezone that is
>     conducive to being online to review tests during the event?
>   * Do you have any other suggestions to test hacking projects at the
>     event? (for example, are there any existing suites out there that
>     could be converted and/or contributed to the W3C?)
>
> Extra awesome if you have something to contribute here AND you speak 
> or write Chinese.
>
> Please note that we'll do our best to incorporate your feedback, but 
> it will depend on how well we can support a particular testing area at 
> the event with experts, reviewers, sample materials, etc.  If you do 
> give us suggestions, we'll likely follow up with you for help in 
> getting them into the program.
>
> Also, you may soon see that I'm sending a similar email to some of the 
> other test suite lists. Sorry for the duplicate mails if you're 
> subscribed to the others; I wanted to keep threads somewhat separated 
> by WG/topic.
>
> Thanks in advance for your input. 'Hope to you see you in Shenzhen!
>
> Cheers,
> -Rebecca & the Test the Web Forward Team

Received on Friday, 6 September 2013 13:57:13 UTC