Fact ranking game (creation of ground truth)

[Apologies for cross-posting. Please redistribute within your own group or among colleagues, thank you!]

In recent years we have experienced an exponential increase of knowledge available on the web. Having such an extensive amount of information poses a challenge when trying to identify globally relevant or important facts. In effort to address this issue, several fact ranking systems have already been developed. However, the difficulty with current state-of-the-art systems is that there is no gold standard corpus which could serve as a ground truth for evaluating their performances.


We have developed a fun and exciting quiz which will help us to tackle this issue by using the wisdom of the crowd. While you are playing, your inputs (which are greatly appreciated) will contribute to our scientific experiment. Together, we will build a first corpus that will help our scientific community in evaluating different fact ranking strategies!


Here you will find our tool<http://s16a.org/fr/> that is used to rank facts about ~500 popular entities from Wikipedia.

You have to register with the tool and then the task will be explained to you in detail. You might interrupt your rating of the presented facts any time you like and continue later. To make it a bit more interesting, you will be able to score points and see your ranking in a highscore list.


We would really appreciate your help in this task. Please do also spread the word. The more participants, the more valid our ground truth will be.


Thanks and best regards,

Semantic Technologies Team

--
Hasso-Plattner-Institut für Softwaresystemtechnik GmbH
Prof.-Dr.-Helmert-Str. 2-3
D-14482 Potsdam
Germany
http://www.hpi.de