Atb.: [ACTION-256]: Compile and circulate itsTool examples togehter with proposal text

Hi everyone,

We had a short discussion with Dave about the different confidence scores and we came up to an understanding that the current version might have issues reflecting various kinds of confidences.

For instance, if we have Named Entity Recognition, Term annotation, then also translation and possible other processes that might affect quality, then:
1) The text analysis confidence does not allow distinguishing between multiple confidences for one tagged element (for instance, 0.1 - termAnnotator1; 0.5 termAnnotator2; 0.7 - namedEntityRecogniser1, etc.)
2) Having different confidence namings will make the standard quite heavy (do we really know all the types of confidences that people might like to add/use? Maybe we should not restrict to the ones specified?)

One solution that I was thinking could be having something like agentConfidence that may contain a complex structure ("0.1|0.5|0.7|etc.") and then have somewhere specified how to understand this sequence.

Any thoughts? Ideas?

Best regards,
Mārcis ;o)
________________________________________
No: Dave Lewis [dave.lewis@cs.tcd.ie]
Nosūtīts: ceturtdiena, 2012. gada 1. novembrī 10:16
Kam: public-multilingualweb-lt@w3.org
Tēma: [ACTION-256]: Compile and circulate itsTool examples togehter with  proposal text

Hi,
The attached file contains a revision to Yves its-tools proposal. I have
also added revised text for mt confidence score and text analysis
annotation revised . Finally, I have also added at the end the examples
from these data categories, showing how the engine identification
information (which I've now removed from the data category), can be
repalced using the its-tools element.

There are comments that need to be addressed in the document. We can go
through these quickly if we wish in the meeting.

cheers,
Dave

Received on Thursday, 1 November 2012 10:02:51 UTC