W3C home > Mailing lists > Public > public-webapps-testsuite@w3.org > September 2013

Re: [testtwf-shenzhen] Need your input: Writing Webapps tests at TestTWF

From: James Graham <james@hoppipolla.co.uk>
Date: Thu, 19 Sep 2013 10:20:31 +0100
Message-ID: <523AC1DF.1090002@hoppipolla.co.uk>
To: public-webapps-testsuite@w3.org
On 19/09/13 01:18, Rebecca Hauck wrote:
> Hi Zhiqiang,
>
> Sorry for the delay on responding to this. Inline below.
>
> On 9/12/13 6:37 AM, "Zhang, Zhiqiang" <zhiqiang.zhang@intel.com> wrote:
>
>> + public-test-infra@w3.org
>>
>>> From: Rebecca Hauck [mailto:rhauck@adobe.com]
>>> Sent: Wednesday, September 11, 2013 6:54 AM
>>
>>>
>>> On 9/9/13 6:00 AM, "Arthur Barstow" <art.barstow@nokia.com> wrote:
>>>
>>>> On 9/6/13 4:03 PM, ext Rebecca Hauck wrote:
>>>>> As you might imagine though, it wouldn't be realistic to
>>>>> expect newcomers to jump into that.
>>>>
>>>> I agree it could be challenging. OTOH, perhaps it could be useful to
>>>> make "reviewing some set of `approved` tests" a prerequisite for
>>>> submitting new tests ;-).
>>>
>>> We definitely do that. In fact, we usually ask the experts to provide
>>> starter tests that serve as good examples upon which new authors can
>>> build
>>> new tests. These starter tests are almost always actual tests that have
>>> been approved. Of course, the difference here is that they're reviewing
>>> tests as a learning mechanism vs. reviewing them to bless them for all.
>>> I'm fairly certain we wouldn't expect (or want) newcomers to be
>>> responsible for the latter.
>>
>> I wonder if it is possible to add a topic, How to Review a Test, at the
>> event.
>
> This is a great suggestion!  Since this event will be just one day, I
> rearranged the schedule to make room for this.

FWIW I am planning to cover this at the WebApps meeting. I'm not sure 
how useful such a session would be to people that have never written a 
test before. On the other hand for regular contributers it is essential, 
because review backlog is an increasing problem. Therefore we might want 
to skip this at TestTWF if all the interested parties are also going to 
be at WebApps.

>>
>> Before that, shall we come to a recommended and practical review process
>> starting from the Test Review and Approval Process [1] and the Test Review
>> Checklist [2]?
>>
>> [1]
>> https://github.com/w3c/testtwf-website/blob/gh-pages/docs/review-process.m
>> d
>> [2]
>> https://github.com/w3c/testtwf-website/blob/gh-pages/docs/review-checklist
>> .md
>
> Yes indeed. Since both of those docs refer to the format[3] and style[4]
> guidelines, we should also consider them when summarizing this into a
> presentation.  It would be really great if you and some of the other
> experienced reviewers on this list review all 4 of these docs and provide
> input. We want something close to consensus on this prior to the event, so
> please speak up if you have opinions. I think the biggest challenge is
> sorting out and clearly communicating the WG-specific requirements for
> tests.

I would be much more inclined to review these pages if they were 
actually live :)
Received on Thursday, 19 September 2013 09:20:57 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 19:57:41 UTC