[![W3C][1]][2] # Core Mobile Web Platform Community Group Face to Face (Mozilla-London) ## 02 Oct 2012 [Agenda][3] See also: [IRC log][4] ## Attendees Present Josh_Soref, Elika_Etemad(fantasai), Dominique_Hazael-Massieux, Jo_Rabin, Bryan_Sullivan, Tobia_Caneschi, Tomomi_Imura_(girlie_mac), Matt_Kelly, Shuhei_Hub, Markus_Leutwyler_(hptomcat), Wonsuk_Lee, Gavin_Thomas, Tobie_Langel, Jean-Francois_Moy, Giridhar_Mandyam, Jonathan_Watt, Jennifer_Leong, Max_NTT, Natasha_GSMA, Robert_Shilston, Mounir_Lamouri, Lars_Erik_Bolstad, Dan_Sun, Jet_Villegas Regrets Chair Jo_Rabin Scribe Josh_Soref ## Contents * [Topics][5] 1. [Welcome][6] 2. [Introductions][7] 3. [Good Morning][8] 4. [Agenda][9] 5. [Objectives: Uncertainties as to what this group is here to do][10] 6. [Dinner][11] 7. [What we are][12] 8. [CoreMob 2012 Document][13] 9. [Dinner][14] 10. [XXQ][15] 11. [Getting Requirements Document][16] 12. [Agenda Adjustment][17] 13. [CoreMob 2012 Current Draft Review][18] * [Summary of Action Items][19] * * * Date: 02 October 2012 Scribe: Josh_Soref ### Welcome jo: Since everyone doesn't know everyone ... it'd be nice if you construct place cards with your names jet: We have markers jo: Good morning everyone ... welcome to CoreMob F2F ... Fire assembly point outside with green something jet: don't use the flip chart markers on the whiteboard ### Introductions jo: I'm Jo, I'm your chair for today+tomorrow... Welcome mattkelly: Matt Kelly, Facebook Robert_Shilston: Robert Shilston, Financial Times Wonsuk: Wonsuk Samsung Electronics Gavin_: Gavin Thomas, Vodafone Josh_Soref: Josh Soref, RIM, scribe fantasai: Elika, Mozilla, scribe jwatt: Jonathan Watt, Mozilla dom: Dominique_Hazael-Massieux, W3C bryan: Bryan Sullivan, AT&T tobie: Tobie, Facebook hub: Shuhei Hub, ARC girlie_mac: Tomomi Imura, Nokia gmandyam: Giridhar Mandyam, Qualcomm Natasha: Natasha, GSMA Max: Max, NTT Docomo hptomcat: Markus, HP, webOS Developer Relations JenniferLeong: Jennifer Leong, AT&T (bridge) jfmoy: Jean-François Moy, France Telecom tobia: Tobia Caneschi, Bonjourno, part of Docomo ... working on a marketplace creating with HTML5 ... developers can monetize with direct operator connection ... i work on the front end side, software architect ... my first time @w3, my pleasure being here ### Good Morning jet: Good morning, welcome ... we talked about fire escape ... i wanted to address the group ... by coming here today, we're signing up to advance the mobile web are slides available on the web e.g. wiki? jet: i hope the group will come together and leave with a shared vision [ Jet will drop a link ] [http://junglecode.net/coremob/coremob.html][20] Another Canvas HTML5 benchmark: [http://html5-benchmark.com/][21] dom: Do you think we should work on benchmarks or test suites? jet: I think both are useful. ... The W3C test suites we use aren't very user-friendly. They take hours to run, and the results are not very digestible. [discussion of browsers changing over time] Wonsuk: ... Mozilla have to conform the compat of web application across different vendors product, right? ... For compliance, they provide some kind of test suite like CTS compliance test cases ... ... develop product based on Android, have to validate their product ... by Google jet: We're trying to sidestep that by being an open web stack ... don't have to recompile, e.g. ... Practically speaking, features get added, deprecated, security fixes change things, etc. ... ... Wonsuk: For browsers, ap developer is responsible for app compatibility ... So you mean this context would be for Firefox OS as well? jet: Yes Wonsuk: So app developer is responsible for compatibility ... vendors \n jet: My hope is you don't really have to do that jet: Our hope is that there will be very little additional testing, by virtue of using a web OS jo: Some things struck me about that presentation, esp. wrt perf ... At Palo Alto f2f, we resolved that although perf was important, we would focus on functional compatibility before we did that ... We also got a little confused, b/c day 1 we said absolute perf measurements, day 2 said relative were better ... There are other groups working on perf, so we can leverage what they're doing ### Agenda jo: I want us to have a quick look at the agenda now, so that we can be clear on what we're going to cover ... First, we have a discussion of objectives. Seems there is still great uncertainty as to what this group is going to do. ... Why are we here, what's our relationship with e.g. Ringmark etc. ... So let's discuss that this morning ... We need to think about what are our actual deliverables ... And what is a realistic timeline for these ... I will keep returning to the issue of resources. We won't make any progress without that. ... Reality check. ... We owe a debt of gratitude to Tobie, for producing tangible stuff ... I know ppl contribute to discussions, but that is not the primary output of this group. ... Some criticism of this group as being driven by FB, but as long as only FB is doing any work, that perception will not change. ... 3 other major objectives ... Coremob-2012 spec, that Tobie's been diligently working on ... I would like us to come to some firm conclusions on that. ... Fundamental decisions about what gets left in / out of that spec, based on what we see the point of that spec being. ... What would it mean to conform to Coremob-2012 ... Would like us to resolve to publish this document ... by the end of this meeting, preferably by end of this day ... Tomorrow, we'll discuss a test framework, and then tests to run in the framework ... I think I was recorded on the last teleconference as saying it's like the difference btw roads and vehicles that run on the roads ... Tobie has written a document which he will introduce tomorrow [Certifying The Core Mobile Web][20] jo: Those are the objectives for this meeting. Anyone have anything to add? [ jo off his proposed schedule ] jet: surrounding meeting rooms are available for breakouts tobie: There's a small project FB HP and Nokia are working on, I'd like to present tomorrow afternoon ### Objectives: Uncertainties as to what this group is here to do jo: There's a big thing missing from our writeups, which is in plain language, why did God put Coremob here on this Earth? ... I don't think that question is clearly address. ... There's a history here, coremob came out of FB effort with Ringmark tobie: Matt started at FB, we started talking to some of our partners, e.g. Samsung ... Given the traction we're seeing behind it, decided to bring it to a CG ... That's pretty much what coremob is ... Ringmark is a test suite that was developed on the side, as a parallel project, with the intent of giving it to the group ... and maybe seeding the group's test suite with it mattkelly: Before we launched this at Mobile Web Congress, we'd been working with a doze dev to build on top of FB apis ... Working with Zynga, Huffington Post, etc. to build mobile apps that had deep social integration ... Decided as a group that best way was to build on the Web ... Allows us to build quickly and deploy across many devices ... Major feature of the platform is usable everywhere ... worked with them for about a year ... altogether, ~14 mobile web apps built from scratched ... It quadrupled the mobile web ap ecosystem ... Along the way we learned a lot, one being that the Web is really hard, for a bunch of reasons ... Particularly, esp from Zynga's standpoint, development was straightforward and simple ... But trying to get it to run across all Android devices at the time, b/c behind the curve, ... Half the project was figuring out why things were so slow, or why couldn't be built ... Once we launched we had a bunch of mobile web apps out there ... Decided a bunch of issues to make this a reality ... Our APIs work everywhere, so would be great if these apps could work everywhere ... We also have our own incentive to build our own app and have it work everywhere ... We took these issues and started talking to Samsung and other OEMs ... And that's the basis behind coremob, and the priorities we decided were important for the mobile web ... Ringmark was a separate but parallel effort, these are the top things that are important to web developers ... Hopefully coremob takes it over ... So I think that's the full history, where we're coming from and what our priorities are ... One important note, we launched ~14 apps, and looking at how many are still live and running... only ~3 are. ... Some were killed off b/c didn't think the user experience was good enough, too slow, etc., couldn't expand in ways good for users. ... Some companies went bankrupt ... Others maintenance costs was more than revenue ... You see the current market conditions, they're not quite right yet. jo: the group is grateful for its genesis from the Facebook initiative ... it isn't tied to it ... it treats all input equally ... as i've observed, Facebook is the biggest contributor, so it has the biggest voice ... it must change.. in order for the group to be successful ... I think we have been extremely unclear ... there is no Idiots Guide to CoreMob ... we do need a simple statement ... I'd like to write a statement in 5 minutes ... In simple terms: CoreMob is here for making the Mobile Web a reasonable platform for developing Mobile Applications ... it is not that today, it's much too hard ... with limited exceptions ... i think it's important to bring a set of features minimally needed to produce an application ... we made a start on this route ... with thanks for bryan/AT&T for pushing that s/biggest group/biggest voice/ [Dom's (handwavy) view on "what is a Web application"][22] JenniferLeong, you wanted to purpose: We're here to improve the mobile web experience for developers and end users tobie: this start is literally word for word the beginning of the charter ... but we're having real issues communicating that ... i'm wondering if a writeup is a good solution ... i'm wondering if the W3C community tool is awful jo: do you have a recommendation for W3C to make it better? tobie: I think we could have our own page ... we could use the coremob domain to point to it ... i'm happy to cede the name fantasai: once you start producing things that are interesting ... it'll be much clearer what you do ... if you just talk about what you want to do ... if you're just talking, it's less clear ... but once you produce things, it'll be clear what you do jo: i've had discussions with people interested in joining ... but they're unclear about what it's trying to achieve **ACTION:** Leong to propose text summarizing the discussion on the list, i.e. what we propose as the "mobile web app" characteristics [recorded in [http://www.w3.org/2012/10/02-coremob-minutes.html#action01][23]] Created ACTION-66 - Propose text summarizing the discussion on the list, i.e. what we propose as the "mobile web app" characteristics [on Jennifer Leong - due 2012-10-23]. dom: you only need to define it as much as you're trying to do Robert_Shilston: surely it's far easier for people to say that CoreMob is the output of what the industry thinks is needed ... and people should be able to follow its output to know what could work tobie: it's easy for small companies ... but it's hard for others ... if we want more resources from members ... we need something they can bring to their companies hptomcat: how do we differ from SysApps? tobie: it's a Working Group ... it produces new technologies hptomcat: do we focus on mobile technology in the web browser? tobie: the key difference in layer in the stack ... Sys Apps WG is lower in the stack ... we're focusing applications I said: "We've recently been asked to share our product roadmap with a prospective tool supplier. I countered that as a tool supplier, the best thing for them to strategically do is follow the coremob 2012 spec as that captures the distilled requirements of mobile developers. " tobie: they're focusing on applications that sit in a native-web system dom: CoreMob references existing specifications that a Web Browser would implement ... whether CoreMob could reference a Sys App spec Tobie then suggested "That's fine for small companies, but many of the people round the table are big companies, and need to work out how to convey back to our organisations what coremob is" dom: do we focus on Sys Apps APIs too? tobie: CoreMob doesn't produce new technology or a question of when? for sysapps - I think the question of "whether it's in scope" should be yes at some point hptomcat: "we could test it?" tobie: testing is supposed to be done by the group that produces the spec I replied "Maybe coremob should act as a broker. If you're a small developer who needs things, then get those suggested to coremob. If you're a big company / vendor / supplier and here at coremob as your company's representative, then you can go back to your company and say 'Coremob is the route by which developers and the community are telling us what they need'. That's why coremob is important - it's brokering information between developers, vendor Josh_Soref: Our target audience is web developers, and sysapps is not actually producing things that will be available through the web. So no. (I think the answer is "not yet") Josh_Soref: That could change, but at least for the next 2 years, it's a no @tobie, Did I capture that right? Robert_Shilston, yup bryan: i think it's a matter of when ... but we should avoid looking too far down the horizon focus on what is short term achievable based upon the web baseline in web browsers particularly focused on mobile use cases dom: how do we communicate this effectively? jo: i think the document needs to say what the group is not ... saying what it's is, and what it isn't are both important ... perhaps an FAQ style document to accompany it would be useful ... I'll make a draft proposal ... 1. our objective is... ... - constituencies are other groups in W3C and other Standards bodies ... - then constituencies who build things on W3C standards ... these two overlap ... - say we're here to represent the voice to groups who need it fantasai: there's 2 directions that you're trying to broker ... industry and what they want ... communicating that to the WG/Vendors who are building the platform ... the aspirational set isn't helpful to people building content today ... the working set isn't useful to people building the platform today jo: the aspirational part not helping developers today ... i agree it's true ... but i think other groups are building that document ... i think we can say "caniuse is doing a good job" ... why repeat their work fantasai: if all you want is aspirational, then you don't need a test suite ... a test suite is for things that are designed tobie: it's important to ensure the implementations get it right dom: test suites used right can be a pressure tool bryan: the experience we had in WAC ... in trying to define a baseline ... developing test suites to validate ... we decided we shouldn't make vendors implement features which aren't coming from Mozilla/WebKit ... in the process, defining a baseline becomes a useless exercise jo: so it's a useless exercise? bryan: it'd be very useful to build a tool that could do testing bryan, you wanted to suggest that the "what is supported" aspect is being addressed by public sites, and the toolset and directional influence that CoreMob can bring is the key jet: i was hoping we could get resolution on the technology transfer from Facebook ... that would clear up Ringmark is/is-not CoreMob ... and also the coremob.org ... let's not start from 0 jo: let's talk about that tomorrow afternoon ... i think we should be open to taking tests from a number of sources ... that requires are test architecture we'd discuss tomorrow morning ... right now the bit on the wiki is caveated jet: we should do that on this meeting jo: we should establish criteria for tests ... not all tests are equal tobie: there's more to talk about on that ... we noticed when mattkelly + I started working on this project ... mobile browsers, unlike desktop browsers, have a lot more relation to the hardware they're on ... one thing we've noticed ... is there's little agreement between OEMs, Chipmakers, Carriers, Vendors ... about what to focus on ... i think that's also a way this group could be very effective ... it's important ... its goal is to acknowledge we should think about it ... "Focus on the same things across the industry" jo: so, broaden the scope to those groups? tobie: i think it's one of the big differences between mobile and desktop dan_: i think the test suite is more urgent ... we all agree there's no good/comprehensive test suite ... if we could evaluate the best test suite for a given area ... identifying that would be helpful jo: i agree with that [The State of Web Apps techs for mobile has some info on W3C test suites availability][24] jo: if CoreMob 2012 is "features needed to build a minimal set of applications running on the framework" ... then we have 3 parts moving at different speeds ... some bits which we need tests for will never have tests ... we should ensure we have a consistent view in this group ... i haven't talked about: ... we need a statement of what's required ... we need a framework ... we need tests to verify things running in the framework to verify things are implemented ... what that framework looks like, we'll talk about tomorrow morning ... where tests come from, and how to assess whether they're any good ... one things fantasai + Josh_Soref emphasized was that test suites could be wrong ... and send things in bad directions ... i'd like to focus on why we're here ... focusing on tobie 's document [ time check ] bryan: we'd like the test system be able to collect data on a per-device basis we would like to ensure that test results can be collected and published on a per-device basis @bryan note that it's also important for people to be able to privately run tests on devices / firmware which might not yet have general- availability. ### Dinner jo: straw poll... how man for dinner (6:30pm) [ 20 people ] ### What we are jo: purpose - a forum for developers to express their needs ... to produce a document, either by amendment or by a further version ... with a note about capturing current state ... my own view is that we don't really have the resources to do that ... even if we wanted to ... i'd like to address which other groups are relevant to our work ... and whether we should establish formal/informal liasons ... other initiatives might include CanIUse, RoboHornet mattkelly: : when we come up with this spec, it'll feed into WGs ... Orientation Lock is half baked ... : Modernizer ... HTML5Test.com tobie: some specs are really good ... but it's unclear to developers about what they should use it for ... HTML 5 Capture ... some have said "it sucks", "use getUserMedia instead" ... but for some things, it's the right thing ... it seems someone could write explanations to help developers understand when they should use a Spec mattkelly: : i think having UCs would help identify when to use a Spec ... saying "GetUserMedia wouldn't be targeting this UC" could be valuable ... beyond that, a test suite tobie: i think the project i'll describe tomorrow kind of addresses that girlie_mac: BrowserScope.org jo: aside from tobie, who's in W3 WGs? jet: CSS gmandyam: DAP, Audio, GeoLoc tobie: WebApps jfmoy: DAP bryan: DAP, WebApps, HTML dom: DAP, WebRTC fantasai: CSS, I18n Josh_Soref: DAP lbolstad: GeoLoc Wonsuk: DAP, WebApps, HTML, SysApps mounir: DAP, WebApps, HTML, SysApps jo: DAP seems to win ... Who is participating/has active knowledge in RoboHornet? mattkelly: : (me) tobie: TestTheWebForward other CG member from AT&T active in WebRTC and WebAppsSec (Dan Druta) jet: +1 fantasai: +1 dom: +0.5 mattkelly: : CanIUse ... : BrowserScope tobie: +1 What about [http://mobilehtml5.org/][25] ? Gavin_: MobileHTML5 tobie: +1 ### CoreMob 2012 Document tobie: document hasn't moved much in the last month ... if you looked recently, there shouldn't be many surprises ... once we've gone through the document today ... we should discuss how and when to publish ... with our main goal being to improve the overall platform ... this is a strategic decision ... we had a number of Action Items/Issues tied to the document link to current version? tobie: i think i've fixed all/most of them ... i think we went over it on the telco a few weeks ago, with things approved in bulk ... changes i've made ... section 2 [http://coremob.github.com/coremob-2012/][26] [ jo projects ] tobie: the box is a bug in the tool ... the tool/database may have moved, so i lost track of where to go to get it fixed bryan: i have a question about getting that fixed out to darobin tobie: i added a conformance section ... you can't ask for a browser to be conformant to something which is impossible ... e.g. color on a black-and-white display jo: Should we say something wrt conforming to a spec vs. passing tests ? (technically, a device without a touch screen conforms to the Touch Event specs by virtue of the truth of predicates applied to the empty set) gmandyam: i see references to specifications in different stages ... what's the overriding philosophy ... GeoLoc is in CR ... DD is DD1 ... File is Draft tobie: W3 has strict rules dom: a related issue ... do we only refer to the spec as a whole or a subset? jo: the resolution at last meeting was in almost every case: As a whole tobie: the slicing should be the work of the WG and not us jet: Compass tobie: like device orientation? jet: a device can do something ... but the OS doesn't allow privileged access ... the device is not necessarily the gatekeeper jo: so expand the definition to include system libraries ... this wording straight from a CSS spec tobie: with the caveat that the only word changed was "device" jo: if we tweak "device" to "device and associated software" tobie: are we making developer's lives easy ... or make vendor's lives easy ... Do we handle a Gaming device w/o SMS ... a Kindle that isn't a Gaming device dom: i think we wait to tweak until someone wants to conform, but can't because of the wording ... i'm suggesting to leave it as is, until someone brings a real life problem jo: change Device to Device and Associated Runtime and raise an issue? fantasai: i'm not sure i agree with that change ... if both Safari and Chrome run on the same system ... and Safari has access to hidden apis ... the capabilities of Safari and Chrome on the device are very different ... that should be communicated its a matter of choice; if chrome had a choice to implement then its a nonconformance if they do not jo: you're saying it's important to name+shame dom: i think anything below the browser is a black box mounir: if you use an API from iOS ... then if you everything you can do, but the API doesn't work ... then you shouldn't be able to say "that's conforming" ... if i can't do touch events because the device doesn't have touch ... if the UA does everything possible, then it is ... i agree with fantasai fantasai: if Google has a problem, they should Shame Apple tobie: is it better for the group's end goal or negotiating the access they need in order to remove the nonconformance? tobie: for Chrome to be able to claim conformance ... or better to be able to complain ... that they can't conform because the APIs are not open mattkelly: : ultimately it's because developers can build an experience ... if i can't get the camera api and i'm building instagram ... google building Chrome on iOS, can't get the access ... they can't conform, they should shame apple tobie: that was my initial view so a capability that is not exposed to after-market browsers can be a non-conformance? we might need at least a way to explain the non-conformance e.g. a reason code in the test results database tobie: but last time the pendulum swung the other way fantasai: i think the text is fine as is jo: do we want a conformance section in our document? ... saying it's aspirational ... these are the features device managers, browser vendors ... should bare in mind ... this document will be ready before a test framework is ready ... before the tests, even before the spec ... conformance to this document is moot right now ... it lives in Cloud-Cuccuo land would removing conformance take any motivation away from development of the test framework? If not, I agree focusing on aspirational text would defer the conformance definition question fantasai: you're building a wish-list ... for what you wish you had in 2012 dan_: some features are not just stable enough jo: the target of people making standards ... saying that "if you don't make these things the web won't be competitive to native apps" ... "which specs are finished/not finished" ... shouldn't be dealt with until we go through the list dan_: if a spec isn't stable enough, then we wouldn't include it jo: i think we should be making a list of features that a reasonable developer would like to have ... to develop now ... existence of a standard isn't important ... i'd like to see the spec as a reference of requirements ... with references to specification work ... and indications of where there's no work fantasai: you need to be clear that you want the features, but not necessarily a spec that's under flux tobie: how do you spec a feature if the feature doesn't exist somewhere? jo: the precise nature is up to the WGs tobie: i don't disagree ... i just don't know how to do it dom: one way is to describe requirements, not features ... a specification that "provides a way to access white balance" dom, you wanted to say that a wishlist is toothless, probably less impactful for developers dom: i'm hearing various things ... not sure how they relate ... 1. a Wishlist ... 2. let browser vendors compete on Conforming (but avoid that word) ... 3. define relatively clearly the features for the wish list ... 4. the wish list seems very aspirational ... #2 seems to require conformance ... the thing you guys did on the top 100 native applications ... looking carefully at what it means to get access to the camera tobie: when we looked at the existing native app ecosystem ... while there's a lot of stuff you can do on native that you can't do on web ... most apps don't rely on them ... look at Games ... most top grossing on mobile use 2D ... they're casual games, not hard-core gamers ... we found the smallest set of stuff to be able to build most apps on native, but using web tech ... then, let's look at what's on the web, in implementations, in specs, implemented/not implemented ... a good 3/4 of the specs are finished + implemented (at least the useful parts) ... then, there's a small set of features not in a complete state ... the big question is on strategy ... how to publish/define it ... cut on features (because there's no spec) ... publish non-spec'd features as a different document (a UC document?) Josh_Soref: So, I think one of the ways to do use cases is to look at apps, ... or to build an app, and say "insert X here, missing this one thing to make this ap really work" ... If you build an app today, want to make sure it works in 2 years ... One way or the other, and probably way to do it is to take real apps and make a mockup of them ... You can publish that, and then ppl can mock up an implementation bryan, you wanted to suggest that if removing conformance focus did not affect likely efforts to assess conformance (or analyze and publish test results in a conformance light) by bryan: ... 3rd party sites, then it would be OK to refocus the doc (people would still say that a given browser "conforms" to whatever we define) jo: my view is that conformance comes later bryan: removing conformance doesn't block people from doing things jo: conformance waits for tests ... this document should be published in say 6 months ... we should publish a different document to drive people to make this document testable dan_: i think we can split this document into two parts ... one part that's ready by the end of the year ... one for the wish list tobie: if we look over the list and decide the majority aren't ready ... we should pause it dan_: can we for each item, identify which is the best thing to test each? [ dan explains the history of CoreMob documents ] [ and how each document gets shelved ] tobie: we should release something now ... showing activity is a valid goal ... but it's a different goal to summarize my point: if others could/would still analyze and publish test results in a conformance light, then it would be OK to defocus conformance in the doc, while retaining focus on test development in the CG tobie: identifying the best test for a spec is important, but different lbolstad: on the topic of removing things ... to Opera as a browser vendor ... the interesting thing was the starting point ... identifying what's needed ... removing stuff because a spec is lacking is going in the wrong direction jo: as dom said, regardless of existence, it's important to identify what's needed [ TIME CHECK ] jo: "What would developers like in their stockings at Christmas?" tobie: this document has been useful to push groups to do things jo: would people like lunch? devs will surely want more than they currently can get, so just measuring based upon current apps would be short-sighted; we need some aspirational use cases as well - where do we find them? [ Lunch ] ### Dinner jo: i couldn't get a reservation for 6:30pm ... i get it for 7:30pm ... go left onto St. Martin's Lane ... up to 7 dials ... take 2nd right ... "earlham st" ... Belgo Centraal ... is the restaurant ### XXQ jo: Requirements ... then, what standards/recs are needed ... related: what's the state of them ... then what tests are needed to verify those have been implemented ... then, a test framework, to address what's needed to run tests ... allowing contributed runs, or excluding a run from being contributed (for private runs) ... Excluded from this: Speed, Memory ... theoretically in scope, but unobtainable ... then, the question of what conformance means ... Conformance to Requirements ... means an appropriate set of Standards/Recommendations has been chosen ... that meets the express needs of the rquirements ... Conformance to Standards ... means that features/detailed aspects of the standard are claimed to have been implemented in an appropriate manner ... All the MUSTs, some of the MAYs, maybe some SHOULDs ... Conformance to Tests ... means that an implementation passes the tests ... We've been discussing what part of the flow chart tobie's document covers ... and whether it's a top down or bottom up thing tobie: you've described Conformance as having a meaning at all of these steps ... i've never heard that definition of Conformance in W3C dom: Conformance is to a Test Suite for a Specification lbolstad: but it's really to verify implementability jo: i think in non technical language, it makes sense to conform to requirements Gavin_: we're trying to build a platform "Fulfillment by a product, process, systems, or service of a specified set of requirements." [http://www.w3.org/TR/qaframe-spec/#glossary][27] Gavin_: but you could have multiple specs that conform to a requirement jo: Requirements => Standards / Recs => Tests => Test Framework ... either CoreMob 2012 is a collection of Requirements ... or it is a list of Standards / Recs that meet these tobie: at CoreMob Palo Alto, I said I was working on a Requirements/UCs document ... it's common form for W3C specs to have a UC/Req section gmandyam: my confusion, relates to how you take this to an automated suite of tests that you can run ... e.g. DeviceOrientation spec ... Ringmark was more of an existence test ... not conformance ... i'd have to hold it, and rotate it jo: i think your point is relevant ... but i'd like to divide the discussion (automated testing necessarily limits the depth of testing we can achieve) jo: whether a test is automatable belongs to Testing/Test Framework ... Conformance exists independently of how the test is executed (just a quick note regarding testing discussion at lunch: crowd sourcing given raw data and specification) tobie: you could have a Conformance requirement that isn't testable within a scope ... but that doesn't make something which doesn't do that Conformant dom: a test suite lets on assess whether something could be conformant ... but it doesn't address completeness ... what we want to define is Usable Conformance ... beyond just Existence ... but less than complete checking ... the definition/discussion is a difficult one ... but something we should confront later jo: Tests = "What tests are needed to verify that claims are true" [http://dev.w3.org/html5/decision-policy/html5-2014-plan.html][28] jo: Test Framework = What's needed to execute these tests in a subset ... because multiday testing is too long (more than verifying their truth, we want to verify some level of truthiness, ideally a level that is informative enough for developers to make choices) jo: [inserts in Tests] Can we say what automated/non-automated tests are automatable [http://coremob.github.com/coremob-test-approach][29] dom: there's a range of options ... in terms of what kind of testing can be done jo: in Palo Alto, we said we needed a way to have sources w/ subsets ... and some database that recorded results ... and a way to render results ... like caniuse/browserscope/... ... we failed to communicate that this is the basic idea [ scribe failed to transcribe picture ] jo: and some way to record things like hard to test (orientation) tobie: it'd be really useful if people read the document ... and also useful is the html5 2014 plan ... describing how they want to test/focus+test the html5 spec ... it seems like a very sane strategy ... we should look at it closely ... and use... jo: ... returning to tobie 's document ... it exists near Specs/Recs ... conformance is what it says in the document ... conformance will mean conformance to those documents as conformant to those documents ... what i'd like is: ... 1. where are the requirements? ... 2. how to decide in/out for document dom: the underlying hard question is how to determine what's in / out of the requirements jo: i'd suggest a digression [ jo + mattkelly: rotate the whiteboard for lack of the crank needed to flip it ] Potential Requirements [CoreMob Mobile Web App Profile][30] mattkelly: : this was a first attempt at finding missing features ... we looked primarily at native apps ... and how people used their phones ... which apps they used actively ... came up with prioritization ... based on time spent ... and then features that were missing ... which seeded ringmark/tobie's spec ... we went through the exercise a handful of times ... it boiled down into a couple of categories ... 1. 2D games ... the vast majority of time on phones today ... we'd worked with Zynga and some others ... for 2D gaming, features aren't missing, they're just slightly broken or have bad perf ... technically has the technical features necessary ... but it wasn't performant ... 2. Audio ... audio needs to happen instantly, and not choppily ... Zynga had tried