- From: Dominique Hazael-Massieux <dom@w3.org>
- Date: Tue, 06 Mar 2007 18:34:14 +0100
- To: public-mwts@w3.org
Hi,
The minutes of our call today are available at:
http://www.w3.org/2007/03/06-mwts-minutes.html
linked from:
http://www.w3.org/2005/MWI/Tests/
and copied as text below.
Dom
------------------------
Mobile Web Test Suites WG Teleconf
6 Mar 2007
[2]Agenda
[2] http://lists.w3.org/Archives/Public/public-mwts/2007Mar/0000.html
See also: [3]IRC log
[3] http://www.w3.org/2007/03/06-mwts-irc
Attendees
Present
Carmelo, dom, dsilaev, Till, Allen
Regrets
David, Rooks, Andrea
Chair
Dom
Scribe
carmelo
Contents
* [4]Topics
1. [5]Mobile Web Test Suites survey and re-packaging
2. [6]Open testing framework for the Mobile Web
3. [7]Next teleconf
* [8]Summary of Action Items
_________________________________________________________
Mobile Web Test Suites survey and re-packaging
Test framework
<dom> [9]Carmelo's test suite framework
[9] http://lists.w3.org/Archives/Public/public-mwts/2007Feb/att-0029/mwi-test-framework.html
Carmelo: conceived a few years ago, modified along time
... used with XSLT, XML Query
... modified a bit more to use in our effort
... not complete, looking for feedback
... Basically, it defines an XML file that describe a collection of
test suites
... each "test-collections" element describes a test suite
... in our case, a test-collection element could point to the CSS MP
test suite
... each test-collection can have one or many "test-group"(s), with
a URL, a title and a description
... within each test group, one or more test-case that uniquely
identifies a test case, with a name, a scenario (e.g. negative test,
error triggering test, comparison test, visual test)
... a description, a spec-citation refering back to the spec
... possibly input/output files depending on the test
... (cf the example at the end of the document)
... Looking for feedback
... This would allow us to track a comprehensive list of tests
... There is a schema associated with that format that allows
validation
... and there is an XSLT to render it in HTML
<dom> ACTION: Carmelo to send his multi-test suite cataloguing
system to the mailing list [recorded in
[10]http://www.w3.org/2007/02/06-mwts-minutes.html#action06] [DONE]
[10] http://www.w3.org/2007/02/06-mwts-minutes.html#action06
<dom> ACTION: Carmelo to send a pointer to how his framework is used
in XML Query test suite [recorded in
[11]http://www.w3.org/2007/03/06-mwts-minutes.html#action02]
Dmitri: is this XML format extensible to contain link to results
coming out of test execution?
Carmelo: the XML file would link to test output files
Dmitri: we may need more extensibility to record more data (e.g. on
which devices it applies)
... but looks good for now
<dom> ACTION: Allen to explore the possibility to have a wrapper for
the test suites [recorded in
[12]http://www.w3.org/2007/02/27-mwts-minutes.html#action09]
[ONGOING]
[12] http://www.w3.org/2007/02/27-mwts-minutes.html#action09
Allen proposed and described a possible schema to navigate the test
suite
based on Tests ID's
<dom> ACTION: Dom to work on prototype of test navigation/results
recording based on Allen's proposal [recorded in
[13]http://www.w3.org/2007/03/06-mwts-minutes.html#action04]
<dom> ACTION: Dom to try and get in touch with user agent developers
(OpenWave and Nokia) [recorded in
[14]http://www.w3.org/2007/03/06-mwts-minutes.html#action05]
DOM Test Suite
<dom> ACTION: Dom to run DOM test suites on his phones [recorded in
[15]http://www.w3.org/2007/02/06-mwts-minutes.html#action02] [DONE]
[15] http://www.w3.org/2007/02/06-mwts-minutes.html#action02
Dom had very little success with DOM
<dom> [16]Getting the DOM Test suite to work on mobile devices
[16] http://lists.w3.org/Archives/Public/public-mwts/2007Mar/0001.html
<dom> ACTION: Carmelo to look into transforming the XML into
javascript files for making them easier to run on mobile devices
[recorded in
[17]http://www.w3.org/2007/03/06-mwts-minutes.html#action07]
Carmelo explained a bit how the DOM test suite is organized (interms
of XML instances)
<dom> ACTION: Till to get feedback from his Opera colleagues on
making the Javascript more usable on mobile devices [recorded in
[18]http://www.w3.org/2007/03/06-mwts-minutes.html#action08]
CSS Test Suite
<dom> ACTION: till to review the WCSS test suite [recorded in
[19]http://www.w3.org/2007/02/27-mwts-minutes.html#action01] [DONE]
[19] http://www.w3.org/2007/02/27-mwts-minutes.html#action01
<dom> [20]WCSS test suite survey from Till
[20] http://lists.w3.org/Archives/Public/public-mwts/2007Mar/0002.html
<Zakim> dom, you wanted to ask for a comparison with the CSS Mobile
Profile test suite
Till - Explained analysis of CSS Test Suite. He ran on his phone
and found it very well structeure and well put together.
High quality test suite.
Till: WCSS test suite quite better than CSS Mobile Profile test
suite; coverage is 98% (vs ~80% for CSS MP) and of high quality
... relies less on font tricks or colors
... I think we should focus on the WCSS test suite - political
matters aside
<dom> ACTION: Carmelo to take a closer look at CSS for coverage
[recorded in
[21]http://www.w3.org/2007/02/06-mwts-minutes.html#action07]
[ONGOING]
[21] http://www.w3.org/2007/02/06-mwts-minutes.html#action07
Carmelo: will send notes I took on this
<dom> ACTION: Dom to get in touch with the CSS WG on cooperating on
the test suite [recorded in
[22]http://www.w3.org/2007/02/27-mwts-minutes.html#action07] [DONE]
[22] http://www.w3.org/2007/02/27-mwts-minutes.html#action07
<dom> [23]Cooperating on improving the CSS MP Test Suite?
[23] http://lists.w3.org/Archives/Member/member-mwts/2007Mar/0000.html
dom: how should we proceed, given Till's analysis?
Till: I think we're interested in both
... I don't think we should forget CSS MP, but maybe not put too
much effort in it
Dom: more to the point, would you be willing to put some of your
time in improving this test suite?
Till: would be willing to, but it's not clear this is the way to go
... maybe we should survey the group on what is the proper way to go
Dom: maybe bind that to the feedback we get from other ua dev?
<dom> ACTION: Dom to ask for feedback on the mailing list about WCSS
vs CSS MP Test Suite? [recorded in
[24]http://www.w3.org/2007/03/06-mwts-minutes.html#action12]
Open testing framework for the Mobile Web
<dom> ACTION: Dom to get feedback on the open test suite on
authoring practices from content developers [recorded in
[25]http://www.w3.org/2007/02/06-mwts-minutes.html#action08] [DONE]
[25] http://www.w3.org/2007/02/06-mwts-minutes.html#action08
<dom> [26]Announcement of survey
[26] http://lists.w3.org/Archives/Public/public-mwts/2007Feb/0032.html
<dom> [27]On-going results of the survey
[27] http://www.w3.org/2002/09/wbs/1/mwits/results?view=compact
Dom: Please help advertize the survey as widely as possible; it will
stay open until March 16
Next teleconf
Dom: beware of change of time for Europeans (one hour earlier)
... Also, I'll likely be away on March 20.
Summary of Action Items
[NEW] ACTION: Carmelo to look into transforming the XML into
javascript files for making them easier to run on mobile devices
[recorded in
[28]http://www.w3.org/2007/03/06-mwts-minutes.html#action07]
[NEW] ACTION: Carmelo to send a pointer to how his framework is used
in XML Query test suite [recorded in
[29]http://www.w3.org/2007/03/06-mwts-minutes.html#action02]
[NEW] ACTION: Dom to ask for feedback on the mailing list about WCSS
vs CSS MP Test Suite? [recorded in
[30]http://www.w3.org/2007/03/06-mwts-minutes.html#action12]
[NEW] ACTION: Dom to try and get in touch with user agent developers
(OpenWave and Nokia) [recorded in
[31]http://www.w3.org/2007/03/06-mwts-minutes.html#action05]
[NEW] ACTION: Dom to work on prototype of test navigation/results
recording based on Allen's proposal [recorded in
[32]http://www.w3.org/2007/03/06-mwts-minutes.html#action04]
[NEW] ACTION: Till to get feedback from his Opera colleagues on
making the Javascript more usable on mobile devices [recorded in
[33]http://www.w3.org/2007/03/06-mwts-minutes.html#action08]
[PENDING] ACTION: Allen to explore the possibility to have a wrapper
for the test suites [recorded in
[34]http://www.w3.org/2007/02/27-mwts-minutes.html#action09]
[PENDING] ACTION: Carmelo to take a closer look at CSS for coverage
[recorded in
[35]http://www.w3.org/2007/02/06-mwts-minutes.html#action07]
[DONE] ACTION: Carmelo to send his multi-test suite cataloguing
system to the mailing list [recorded in
[36]http://www.w3.org/2007/02/06-mwts-minutes.html#action06]
[DONE] ACTION: Dom to get feedback on the open test suite on
authoring practices from content developers [recorded in
[37]http://www.w3.org/2007/02/06-mwts-minutes.html#action08]
[DONE] ACTION: Dom to get in touch with the CSS WG on cooperating on
the test suite [recorded in
[38]http://www.w3.org/2007/02/27-mwts-minutes.html#action07]
[DONE] ACTION: Dom to run DOM test suites on his phones [recorded in
[39]http://www.w3.org/2007/02/06-mwts-minutes.html#action02]
[DONE] ACTION: till to review the WCSS test suite [recorded in
[40]http://www.w3.org/2007/02/27-mwts-minutes.html#action01]
Received on Tuesday, 6 March 2007 17:35:43 UTC