Re: Annotation of Timed Text

It seems that "annotation" and "meta-data" have quite a conceptual overlap,
but are not the same in current usage.

Annotations are included in XML Schema as full elements. TT Requirements
include meta-data elements that could be used for annotation, but it seems
that some annotations might not fit that model, for example, if an
annotation didn't reference a single element, but needed to say "element 1
doesn't agree with element 7". That could be shifted to an "external" form
of annotation document that just points to the multiple TT document contents
elements, but given that there wouldn't be reverse pointers, would it be
possible to display that external annotation material simultaneously in a
timed manner? If there was some sort of dynamic formation of a combined
document for timed display, wouldn't the structure need to support
distinctions between content and annotation anyway?

I note that MPEG-7 is mentioned in an editorial comment in TT Requirements.
Doesn't MPEG-7 do much of what Timed Text will do? It seems to address
annotation also. Possibly there should be more connection between the two.

Regards,
John Hanna

----- Original Message -----
From: "Dave Singer" <singer@apple.com>
Sent: Thursday, June 26, 2003 12:13 PM
Subject: Re: Annotation of Timed Text


> At 12:06 -0400 6/25/03, John Hanna wrote:
> >On Tuesday, June 24, 2003 4:02 PM Glenn A. Adams said...
> >>  We haven't discussed annotating. Could you give some concrete
> >>  use case scenarios?
>
> Isn't "annotation" another word for "meta-data" or do you see these
> as distinct?  It seems that many domains may need domain-specific
> data associated with the timed-text.
>
> >
> >Consider the use of digital video (including audio) for research and
> >education. A video is observed and interpreted from a particular
> >perspective, and a Timed Text record made of the interpretation. The
record
> >could be a complex structure, akin to descriptive captioning, with
> >transcriptions of dialog, descriptions of movement and events, etc. This
> >would be displayed in a browser or media viewer panel synchronized with
the
> >video. For research, review comments about the interpretation would
annotate
> >the record and be presented in the timed display. For Education,
> >supplementary hints about how to view the scenes and pick out the
referenced
> >aspects, or even instructor notes, would annotate the record and
optionally
> >be presented in the timed display. Of course the record and annotations
> >could also be viewed in a non-timed manner. To emphasize the video
aspects
> >associated with the timed text, an overlay of tracking highlights could
mark
> >video objects and be keyed (e.g., by color) to the text.
> >
> >Another example would be for an animated storyboard or movie, with the
> >screenplay presented in timed text (although there may not be a
screenplay
> >DTD/schema yet). Annotations would pertain to hints or comments for all
the
> >different production roles, or for cinema studies.
> >
> >From a human factors perspective, having labels and descriptions closer
and
> >more directly associated with the video objects would be best. Possibly
the
> >timed text dialog should be displayable in a talk-balloon that moves with
> >the speaker. Is that within the scope of ways timed text can be
presented,
> >or is it moving into animation?

Received on Friday, 27 June 2003 11:12:44 UTC