W3C home > Mailing lists > Public > public-webapps-testsuite@w3.org > September 2013

Re: [testtwf-shenzhen] Need your input: Writing Webapps tests at TestTWF

From: Rebecca Hauck <rhauck@adobe.com>
Date: Wed, 18 Sep 2013 17:18:12 -0700
To: "Zhang, Zhiqiang" <zhiqiang.zhang@intel.com>, Arthur Barstow <art.barstow@nokia.com>
CC: "public-webapps-testsuite@w3.org" <public-webapps-testsuite@w3.org>, "public-testtwf-planning@w3.org" <public-testtwf-planning@w3.org>, "'public-test-infra@w3.org'" <public-test-infra@w3.org>
Message-ID: <CE5F8C90.41591%rhauck@adobe.com>
Hi Zhiqiang,

Sorry for the delay on responding to this. Inline below.

On 9/12/13 6:37 AM, "Zhang, Zhiqiang" <zhiqiang.zhang@intel.com> wrote:

>+ public-test-infra@w3.org
>
>> From: Rebecca Hauck [mailto:rhauck@adobe.com]
>> Sent: Wednesday, September 11, 2013 6:54 AM
>
>> 
>> On 9/9/13 6:00 AM, "Arthur Barstow" <art.barstow@nokia.com> wrote:
>> 
>> >On 9/6/13 4:03 PM, ext Rebecca Hauck wrote:
>> >> As you might imagine though, it wouldn't be realistic to
>> >> expect newcomers to jump into that.
>> >
>> >I agree it could be challenging. OTOH, perhaps it could be useful to
>> >make "reviewing some set of `approved` tests" a prerequisite for
>> >submitting new tests ;-).
>> 
>> We definitely do that. In fact, we usually ask the experts to provide
>> starter tests that serve as good examples upon which new authors can
>>build
>> new tests. These starter tests are almost always actual tests that have
>> been approved. Of course, the difference here is that they're reviewing
>> tests as a learning mechanism vs. reviewing them to bless them for all.
>> I'm fairly certain we wouldn't expect (or want) newcomers to be
>> responsible for the latter.
>
>I wonder if it is possible to add a topic, How to Review a Test, at the
>event.

This is a great suggestion!  Since this event will be just one day, I
rearranged the schedule to make room for this.


>This will not only benefit  new reviewers to understand the review
>process,
>but help new authors to know about what is to be checked before
>submitting new tests.

Yes, totally agree. We might want to adjust the title a little to reflect
this something like "How to Do Reviews and Pass Reviews". I'm open to
suggestions. Of course, my next logical question to you Zhiqiang is would
you like to take this on and do the talk at the event? :)  The talk and
slide deck should be in Chinese, but we'd definitely want an English
version of the deck available beforehand. I can work with you on this if
it helps.


>
>Before that, shall we come to a recommended and practical review process
>starting from the Test Review and Approval Process [1] and the Test Review
>Checklist [2]?
>
>[1] 
>https://github.com/w3c/testtwf-website/blob/gh-pages/docs/review-process.m
>d
>[2] 
>https://github.com/w3c/testtwf-website/blob/gh-pages/docs/review-checklist
>.md

Yes indeed. Since both of those docs refer to the format[3] and style[4]
guidelines, we should also consider them when summarizing this into a
presentation.  It would be really great if you and some of the other
experienced reviewers on this list review all 4 of these docs and provide
input. We want something close to consensus on this prior to the event, so
please speak up if you have opinions. I think the biggest challenge is
sorting out and clearly communicating the WG-specific requirements for
tests. 


Thanks so much for suggesting this!

Cheers,
-Rebecca

[3] 
https://github.com/w3c/testtwf-website/blob/gh-pages/docs/test-format-guide
lines.md
[4] 
https://github.com/w3c/testtwf-website/blob/gh-pages/docs/test-style-guidel
ines.md
Received on Thursday, 19 September 2013 00:18:34 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 19:57:41 UTC