RE: [VER 2] {minutes} HTML WG media telecon 2013-04-09 - MSE bug discussion

Minutes -> http://www.w3.org/2013/04/09-html-media-minutes.html


                               - DRAFT -

                  HTML Media Task Force Teleconference

09 Apr 2013

   [2]Agenda

      [2] http://lists.w3.org/Archives/Public/public-html-media/2013Apr/0039.html


   See also: [3]IRC log

      [3] http://www.w3.org/2013/04/09-html-media-irc


Attendees

   Present
          Michael_Thornburgh, glenn, pal, Bin, markw, [Microsoft],
          Aaron_Colwell, +1.404.269.aaaa, ReimundoGarcia, ddorwin,
          BobLund, adrianba, Bin_Hu

   Regrets
   Chair
          aaron colwell

   Scribe
          adrian bateman

Contents

     * [4]Topics
         1. [5]CfC: to publish a heartbeat Media Source Extensions
            Working Draft
         2. [6]F2F meeting topics
         3. [7]Discussion of outstanding bugs
         4. [8]out of order appends
         5. [9]Adjournment
     * [10]Summary of Action Items
     __________________________________________________________

   <trackbot> Date: 09 April 2013

   <markw> I guess Paul cannot make it. Anyone want t chair ?

   <markw> (I'm on a bus - noisy - otherwise I'd volunteer)

   <acolwell> I can chair

   <markw> hooray, we can start ;-)

   <scribe> scribenick: adrianba

   <scribe> scribe: adrian bateman

   acolwell: i published an updated version of the spec with 5 bug
   fixes
   ... mostly clarifications, nothing too huge

CfC: to publish a heartbeat Media Source Extensions Working Draft

   WG Decision:
   [11]http://lists.w3.org/Archives/Public/public-html-admin/2013A

   pr/0023.html

     [11] http://lists.w3.org/Archives/Public/public-html-admin/2013Apr/0023.html


   adrianba: think we need to work with Robin or Mike to get this
   published

F2F meeting topics

   acolwell: thought we could talk about what we need to do to get
   to last call
   ... seems like the bug count is pretty low
   ... do we want the slot at the face-to-face?

   adrianba: i'd like to see us make progress towards LC
   ... perhaps we can give notice to the WG that we're getting
   close

   pal: would like to do this on the 23rd at the f2f

   acolwell: think we can put in a request for the 23rd but it
   might not be decided before everyone is in the room

   adrianba: does anyone on the call object to requesting 23rd?
   perhaps we could add this to the wiki

   acolwell: not hearing any objections
   ... anything else about the f2f meeting?

Discussion of outstanding bugs

   adrianba: would like to discuss out of order appends in this
   section

   acolwell: let's address that after the others

   Bug 20760: <video> Expose statistics for tracking playback
   quality

   [12]https://www.w3.org/Bugs/Public/show_bug.cgi?id=20760


     [12] https://www.w3.org/Bugs/Public/show_bug.cgi?id=20760


   markw: discussion has a tendency to grow out of control - is a
   real problem related to adaptive streaming
   ... for some devices that can't play high quality videos

   [lost some of the comment at the end]

   adrianba: two issues - are the metrics the correct ones and
   where should it be specified
   ... on the first, i think i'd like to see more discussion on
   the detail of the proposal
   ... on the second, i think this is clearly tied to key use
   cases for MSE, we've asked in the past to include this in an
   appendix so it gets done, but we'll be guided by the consensus
   of the WG for where it is written down

   acolwell: my main concern is that there currently isn't a
   mechanism for recording statistics on media element
   ... and if the HTML WG decides to specify that then there might
   be two
   ... i'd like to get consensus for how to expose this and then
   decide where to put it

   markw: i think we probably should have a target that there is
   something comprehensive on the element
   ... the discussion is quite a long way from going somewhere in
   the WG
   ... don't think there is much chance of this going forward
   quickly
   ... think this is important for deployments of MSE and we need
   this implementation experience to drive the spec forward
   ... would like to see something in MSE with the understanding
   it might be replaced in future

   adrianba: we are the HTML WG and the full WG needs to agree
   with the output from the TF'

   s/TFTF/

   acolwell: next step is to solicit comments from the WG?

   adrianba: yes

   Bug 19676 - timestampOffset accuracy

   [13]https://www.w3.org/Bugs/Public/show_bug.cgi?id=19676


     [13] https://www.w3.org/Bugs/Public/show_bug.cgi?id=19676


   <acolwell>
   [14]https://www.w3.org/Bugs/Public/show_bug.cgi?id=19676


     [14] https://www.w3.org/Bugs/Public/show_bug.cgi?id=19676


   acolwell: let's go to this one since pal wants to talk to it

   pal: subject of lengthy discussion
   ... in the last comment, editor suggests additional
   implementation experience is necessary
   ... my first suggestion is that in that case the bug should be
   kept open and not closed

   acolwell: i could mark as resolved later instead of resolved
   fixed
   ... that's how we marked some other things
   ... trying to drive the bug count to zero
   ... to get to LC

   pal: sympathise with the desire to mark as resolved
   ... but don't see how this is done

   glenn: prefer to resolve as fixed and open a new bug in future
   ... to vague to say needs implementation experience
   ... that's the purpose of CR phase

   adrianba: agree with glenn

   pal: glenn and adrian, don't believe this is a subjective
   question, very much mathematical
   ... spec says as accurate as possible
   ... bug was opened because of accuracy of timestamp
   ... comfortable with seeing how implementations work around
   that but uncomfortable saying this is resolved

   glenn: my experience, we make decisions in a somewhat
   speculative manner and then move to implementation phase and
   open new bugs if we find them
   ... problem is lack of specific change to make other than
   keeping open

   pal: very early in the thread there is a very specific
   suggestion for how to resolve

   adrianba: if there is a concrete text alternative proposal then
   i think you should reopen the bug
   ... there is a process within the WG to resolve the situation
   when
   ... there is not a clear consensus for what the spec should say
   ... if we have differing proposals the chairs will run this
   process
   ... to decide what the spec should say

   acolwell: i believe i addressed the suggestion for rationals in
   comment 9

   [15]https://www.w3.org/Bugs/Public/show_bug.cgi?id=19676#c9


     [15] https://www.w3.org/Bugs/Public/show_bug.cgi?id=19676#c9


   acolwell: using a single rational doesn't solve the problem
   because of if you mix content of different frame rates
   ... i believe the spec text provides sufficient mechanism to be
   close enough
   ... and avoid the problem of if a frame is slightly after the
   last frame it would get removed
   ... i think the time differences because of using the double
   would not be perceivable by the user
   ... that's why i think implementation experience is needed
   ... all implementations will likely round to some precision
   ... and it will be too difficult to specify precisely how
   different implementations will do this rounding

   pal: i agree, fine with waiting for implementations
   ... what i wanted to bring up was marking a bug as resolved
   when it looks like additional experience is needed doesn't feel
   right

   acolwell: as i say, i could resolve as later

   pal: this would help look back at the end at the bugs we
   weren't sure of
   ... sounds reasonable to me

   acolwell: okay with everyone else?
   ... does anyone object to resolving this as LATER

   adrianba: no objection

   acolwell: not hearing anything - just updated the bug, now
   RESOLVED LATER

   Bug 21298 - Clarify relationship between SourceBuffer, input
   buffer, and tracks

   [16]https://www.w3.org/Bugs/Public/show_bug.cgi?id=21298


     [16] https://www.w3.org/Bugs/Public/show_bug.cgi?id=21298


   acolwell: two parts to this
   ... one is a request for a diagram showing how appended data
   moves through MSE
   ... i agreed to come up with a diagram for that
   ... second part is writing a primer on MSE so that people can
   more easily understand how this works
   ... i don't know what the process for this is
   ... if we decide to take this on we might need to recruit some
   for this
   ... i will work on the diagram for the next spec update
   ... question is do we want to work on a primer and if so do we
   have someone willing?

   adrianba: no objections to someone doing it but in the absence
   of someone who wants to do this then it won't happen

   acolwell: should this be a bug?

   adrianba: maybe the chairs could issue a call for volunteers

   glenn: this could be marked LATER too

   Bug 21431 - Specify splicing behavior for text tracks

   [17]https://www.w3.org/Bugs/Public/show_bug.cgi?id=21431


     [17] https://www.w3.org/Bugs/Public/show_bug.cgi?id=21431


   acolwell: haven't had a lot of chance to fully digest the
   discussion here
   ... but i think this is going to require some work
   ... different to audio and video because of overlapping
   ... and truncating is more difficult
   ... i will have some comments on this and areas we need to
   consider
   ... this seems to be the most work in outstanding bugs

   glenn: i would suggest an approach with a default behaviour
   independent of text track usage
   ... semantics similar to audio should also apply
   ... aggressive segementation should occur and no overlaps
   considered as a default
   ... if specific text track uses want to specify some behaviour
   accounting for overlap they can
   ... text tracks include lots of different types of metadata and
   i don't think we'll come up with one rule for all

   <BobLund> +1 for Glenn's suggestion

   acolwell: planned to do a run through with different webvtt
   constructs
   ... as long as no overlapping ranges then would be okay

   glenn: in ttml there are overlapping ranges so can't be ruled
   out

   acolwell: yeah, figured it would need to be addressed - any
   help would be appreciated

   glenn: i'm suggesting not trying to solve in this spec
   ... let the text track usage specify as necessary

   acolwell: i will clarify what i think the existing behavior
   should be and we can assess if this is okay for the default

   glenn: that's what i'm suggesting

   Bug 21536 - Specify the origin of media data provided using
   Media Source Extensions

   [18]https://www.w3.org/Bugs/Public/show_bug.cgi?id=21536


     [18] https://www.w3.org/Bugs/Public/show_bug.cgi?id=21536


   acolwell: adrianba, you commented on this - is it resolved?

   adrianba: the bug asks the question what origin should we
   specify MSE data
   ... my answer is same origin as the page
   ... assign to me and i'll propose some text

out of order appends

   acolwell: adrianba, you wanted to talk about out of order
   append

   <markw> what?!?

   adrianba: when we added support for MPEG2TS, we made out of
   order appends an error
   ... did we mean this to happen to all formats including those
   that don't need it?
   ... this makes the programming model complex and web apps need
   to keep calling abort()

   <BobLund> +q

   markw: surprised we made this change, out of order appends
   seems like a part of our original design
   ... would prefer to return to the original design

   BobLund: agree with adrian's sentiment
   ... i don't think mpeg2ts imposed a solution that resulted in
   this situation
   ... mpeg2ts text tried to account for the timing discontinuity
   ... nothing in mpeg2ts byte stream spec that dictated this
   solution

   acolwell: problem was mpeg2ts don't really have media segment
   concept
   ... difficult to detect discontinuity or out of order append
   ... introduction of append sequence made explicit that things
   are adjacent

   any time i want to append something not adjacent then have to
   call abort

   scribe: intention not to prevent out of order appending
   ... just indication that things are expected to be continuous

   BobLund: in mpeg2 there is discontinuity indicator

   <Michael_Thornburgh> +q

   BobLund: for appends where it is intention that there is a
   discontinuity that indicator will be set
   ... not obvious to me why appending with timestamps not
   continuous not allowed

   markw: maybe misunderstood summary at beginning
   ... would be better if ability to append out of order without
   abort was allowed
   ... and case where needs to be explicit accounted for
   separately

   Michael_Thornburgh: apple's hls won't have discontinuity in the
   TS itself - will be in the manifest
   ... also if you're seeking around you might not be appending
   segment with discontinuity
   ... thought changes to api would just work in that situation
   ... default is the to use the timestamps
   ... and only in the mode where you say to ignore the timestamps
   would the other behaviour happen

   [19]https://dvcs.w3.org/hg/html-media/raw-file/tip/media-source

   /media-source.html#sourcebuffer-coded-frame-processing

     [19] https://dvcs.w3.org/hg/html-media/raw-file/tip/media-source/media-source.html#sourcebuffer-coded-frame-processing


   step 7

   acolwell: main issue where this comes up is for cases where i
   have a discontinuity frame at end of one append
   ... and the packet on the other side of discontinuity in next
   append
   ... in that situation, if you can't assume one append after the
   other are adjacent to each other
   ... then UA can't determine if this was out of order append or
   not
   ... if you happen to append TS one packet at a time then you
   can't differentiate out of order append from discontinuity
   ... open to other solutions for how to solve for this
   ... e.g. both sides of discontinuity occur in same append
   ... but pushback because might not know if it is in there
   ... if app doesn't know where the discontinuity is then have to
   handle in unambiguous way

   <markw> +1

   adrianba: maybe something could be in the append to indicate
   how to handle next data
   ... rather than having abort keep the next status

   <markw> void appendBuffer( ArrayBuffer data, optional bool
   timeContinuous );

   adrianba: then if you use a format that doesn't need this you
   don't need to worry about it

   <markw> void appendBuffer( ArrayBuffer data, optional bool
   timeContinuous = false );

   acolwell: will also think about this
   ... over time
   ... any other items?

Adjournment

   <markw> Thanks for chairing, Aaron

   acolwell: then we're adjourned

   acolwell, thanks for chairing

Summary of Action Items

   [End of minutes]


-----Original Message-----
From: Paul Cotton 
Sent: Tuesday, April 9, 2013 1:12 AM
To: public-html-media@w3.org
Cc: Aaron Colwell <acolwell@google.com> (acolwell@google.com); Adrian Bateman; Mark Watson; Pierre-Anthony Lemieux (pal@sandflow.com)
Subject: [VER 2] {agenda} HTML WG media telecon 2013-04-09 - MSE bug discussion 

[VER 2] takes into consideration the updated MSE draft announced on April 8.  I have specifically added the remaining 4 open bugs and one FIXED bug that I received a specific request for.

The HTML WG media teleconference meeting will occur on 2013-04-09 for up to 60 minutes from 15:00Z to 16:00Z.

http://timeanddate.com/s/2cjv 

Tokyo midnight, Madrid/Amsterdam/Oslo 17:00, London/Dublin 16:00, New Jersey/York 11:00, Kansas City 10:00, Seattle/San Francisco 08:00.

Chair of the meeting: Paul Cotton
Scribe: TBD

(See the end of this email for dial-in and IRC info.)

== Agenda ==

1. Roll call, introductions and selection of scribe

2. Previous meeting minutes
http://www.w3.org/2013/03/19-html-media-minutes.html


3. Review of action items
https://www.w3.org/html/wg/media/track/

None.

4. Baseline documents 

a) Media Source Extensions editor's draft: 
http://dvcs.w3.org/hg/html-media/raw-file/tip/media-source/media-source.html

Status as of April 8:  Last updated on Apr 8:
http://lists.w3.org/Archives/Public/public-html-media/2013Apr/0038.html


5. CfC: to publish a heartbeat Media Source Extensions Working Draft
http://lists.w3.org/Archives/Public/public-html-admin/2013Mar/0037.html 
WG Decision to publish is recorded at:
http://lists.w3.org/Archives/Public/public-html-admin/2013Apr/0023.html 

6. F2F meeting topics
http://lists.w3.org/Archives/Public/public-html-media/2013Mar/0053.html 

a) Does MSE want to request a slot for discussion at the F2F?  Length of such an agenda slot?
http://www.w3.org/wiki/HTML/wg/2013-04-Agenda#Potential_Topics

Note:  At a previous TF meeting some MSE participants recommended that they wanted to discuss outstanding bugs and getting into Last Call at the F2F meeting.  Therefore I have already added such a request.  This agenda item is thus to confirm that plan.

7. Discussion of outstanding bugs

a) Media Source Extensions bugs: 
http://tinyurl.com/6pdnzej

Status as of April 8: 4 bugs (see agenda items below)

b) Bug 20760: <video> Expose statistics for tracking playback quality
https://www.w3.org/Bugs/Public/show_bug.cgi?id=20760 

c) Bug 21298 - Clarify relationship between SourceBuffer, input buffer, and tracks
https://www.w3.org/Bugs/Public/show_bug.cgi?id=21298


d) Bug 21431 - Specify splicing behavior for text tracks
https://www.w3.org/Bugs/Public/show_bug.cgi?id=21431 

e) Bug 21536 - Specify the origin of media data provided using Media Source Extensions
https://www.w3.org/Bugs/Public/show_bug.cgi?id=21536 

f) Bug 19676 - timestampOffset accuracy
https://www.w3.org/Bugs/Public/show_bug.cgi?id=19676 
Note: I received a request from Pierre to add this FIXED bug to the agenda for further discussion.
 
8. Other Business

9. Chair and Scribe for next meeting

10. Adjournment

== Dial-in and IRC Details ==

Zakim teleconference bridge:
   +1.617.761.6200, conference 63342 ("media")
https://www.w3.org/Guide/1998/08/teleconference-calendar#s_5366


Supplementary IRC chat (logged):
   #html-media on irc.w3.org port 6665 or port 80

Paul Cotton, Microsoft Canada
17 Eleanor Drive, Ottawa, Ontario K2E 6A3
Tel: (425) 705-9596 Fax: (425) 936-7329

Received on Tuesday, 9 April 2013 16:22:22 UTC