Re: [EMOXG] XML suggestion for Meta 1: Confidence

Hi,

Breen, Andrew schrieb:
> I think it is asking a lot of a developer to have to define so many confidence levels, I think we need to make these optional. With the assumption that if no confidence level is indicated it is assumed to be fully confident.

Agreed -- confidence should be optional throughout.

> I'm also unsure about the practical use of applying a confidence to a dimension if the emotion is marked as low confidence.  Is it likely that if an emotion is given low confidence that a high confidence on a dimension will have any meaning?

The practical use comes out of the two kinds of use cases: "manual 
annotation", and "automatic emotion recognition". In the first case, a 
human annotator may want to indicate that he/she is not sure about the 
annotation, but it's the best they could do; in the second case, many 
classification algorithms come with confidence measures. Whether only 
confidence above a certain threshold should lead to an annotation being 
emmitted is a software design issue, in my view.

> I'm against using terms such as "very much", "very negative" in confidence measures, as this leaves far too much room for personal interpretation. Using numbers provides some security against this e.g. there can be much less personal interpretation of the meaning of a value 0.5 in a defined range of 0 to 1.

The reason I suggest this is the same as for the other scales: human 
annotators usually use only discrete ordinal scales.

Cheers,
Marc


-- 
Dr. Marc Schröder, Senior Researcher at DFKI GmbH
Coordinator EU FP7 Project SEMAINE http://www.semaine-project.eu
Chair W3C Emotion ML Incubator http://www.w3.org/2005/Incubator/emotion
Portal Editor http://emotion-research.net
Team Leader DFKI Speech Group http://mary.dfki.de
Project Leader DFG project PAVOQUE http://mary.dfki.de/pavoque

Homepage: http://www.dfki.de/~schroed
Email: schroed@dfki.de
Phone: +49-681-302-5303
Postal address: DFKI GmbH, Campus D3_2, Stuhlsatzenhausweg 3, D-66123 
Saarbrücken, Germany
--
Official DFKI coordinates:
Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany
Geschaeftsfuehrung:
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
Dr. Walter Olthoff
Vorsitzender des Aufsichtsrats: Prof. Dr. h.c. Hans A. Aukes
Amtsgericht Kaiserslautern, HRB 2313

Received on Thursday, 7 August 2008 07:31:39 UTC