W3C home > Mailing lists > Public > public-device-apis@w3.org > April 2010

Re: A Proposal for the Testing Framework

From: Brian LeRoux <brian@westcoastlogic.com>
Date: Fri, 30 Apr 2010 11:02:48 -0700
Message-ID: <k2sa4bcf6321004301102k53c33ee8m6ab4382f013038a6@mail.gmail.com>
To: Anssi Kostiainen <anssi.kostiainen@nokia.com>
Cc: ext Kai Hendry <hendry@aplix.co.jp>, "public-device-apis@w3.org WG" <public-device-apis@w3.org>
Yes, we did experiment with a number of the aforementioned options
before settling on qUnit. It would be great if we could adapt
mobile-spec to the DAP test suite or at least provide some manpower in
getting it started. As to functional testing, its nearly impossible on
most platforms without spelunking into some pretty nasty, undocumented
api calls. Though now I'm thinking it sounds like a fun project. ;D



On Fri, Apr 30, 2010 at 1:14 AM, Anssi Kostiainen
<anssi.kostiainen@nokia.com> wrote:
> Hi,
>
> On 29.4.2010, at 21.53, ext Kai Hendry wrote:
>
>> On 29 April 2010 19:40, Brian LeRoux <brian@westcoastlogic.com> wrote:
>>> +1 for qUnit. We use it for the mobile-spec for phonegap and it runs
>>> perfectly on all mobile devices which is a huge bonus.
>>
>> +1 for Qunit, though it does not work on WinMo 6.1 on which the BONDI
>> ri is based.
>>
>> This is why my colleague wrote runner.js for OMTP BONDI:
>> http://bondidev.omtp.org/BWiki/BONDI%20Compliance.aspx
>
> QUnit seems like a reasonable choice for unit testing given that the PhoneGap folks have already validated its applicability across major mobile OSs (Brian: any problems so far, also did you evaluate others such as JsUnit, YUITest..?). Mobile-spec also has some tests that may be re-usable to some extend, which is nice.
>
> About the scope. Unit testing only covers headless APIs (input/output, functions, events) and not UI interactions (e.g. file picker interactions in the Media Capture API). Are we happy leaving functional testing out of the scope for now? AFAIK there are no mobile friendly functional testing tools available and I assume we don't want to roll our own -- especially given that such tools tend to be browser/platform specific. Selenium seems to be the most popular in the desktop space, but that may not help us much here.
>
> Kai - The WinMo 6.1 QUnit incompatibility may have been due to jQuery? Nowadays QUnit is a standalone test runner i.e. the dependency on jQuery was removed [2]. Which version did you evaluate?
>
> -Anssi
>
> [1] http://github.com/phonegap/mobile-spec/tree/master/tests/
> [2] http://github.com/jquery/qunit/commit/c15c735605258c3756037e9b85e873d54bc29a85
>
>
>
>
>
Received on Friday, 30 April 2010 18:03:21 UTC

This archive was generated by hypermail 2.3.1 : Monday, 23 October 2017 14:53:43 UTC