Re: Video filter

On 04/16/2015 01:08 AM, Rob Manson wrote:
> There's definitely common and useful functions that could be optimised 
> for video post processing.
>
> I don't think we need to boil the ocean and birth the full equivalent 
> of Web Audio 8)
>
> Yet some well chosen extensions could deliver a lot of benefits with 
> minimal effort.
>
> And it does seem to fit well with the WG's scope.
>
> - API functions for encoding and other [processing] of those media 
> streams
> - API functions for decoding and [processing] (...) of those streams 
> at the incoming end

Not saying that we have the perfect solution, but we do have a set of 
solutions already specified.....

The encoding is already spec'ed out in the recording API.
Decoding an encoded stream can be done by the Media Source API (our test 
implementation of recording verified correctness by feeding the 
resulting chunks to the Media Source API).

Getting from decoding back to a MediaStream can be done by using the 
"Media Capture from DOM elements" specification.

So I'd say that we have all the pieces to make a loop, and would 
encourage anyone who finds a place where the loop is broken to file a 
bug on the relevant spec.

>
> I'd like to put together a Use Cases document and would welcome any 
> input from other people interested.

I'd be happy to see such a document pulled together.
Note that we have a (rather old) "MediaStream Capture Scenarios" 
document here:

http://w3c.github.io/mediacapture-scenarios/scenarios.html

This can be taken as input, background or however you want to treat it.

>
> roBman
>
>
> On 16/04/15 8:00 AM, Silvia Pfeiffer wrote:
>>
>>
>> On 15 Apr 2015 22:37, "Harald Alvestrand" <harald@alvestrand.no 
>> <mailto:harald@alvestrand.no>> wrote:
>> >
>> > On 04/15/2015 01:43 PM, Silvia Pfeiffer wrote:
>> >>
>> >>
>> >> Right, developing something more akin to the web audio api for 
>> video would be a nice new piece of work. Pretty substantial, too, of 
>> you wanted to build in all the feature extraction approaches typical 
>> in video analysis!
>> >>
>> >
>> > Not to mention a field rich in intellectual property.....
>> >
>>
>> To be honest, I don't think this should stop us if we have a real 
>> need. Didn't stop us for web audio or web rtc. But it does make life 
>> difficult.
>>
>> Cheers,
>> Silvia.
>>
>>
>

Received on Thursday, 16 April 2015 09:48:44 UTC