W3C home > Mailing lists > Public > semantic-web@w3.org > August 2014

Fact ranking game (creation of ground truth)

From: Bobic, Tamara <Tamara.Bobic@hpi.de>
Date: Wed, 13 Aug 2014 14:57:21 +0000
To: "semantic-web@w3.org" <semantic-web@w3.org>
Message-ID: <B8A684431F48D94694C6E77D80C02EBA611912@MXMA2012.hpi.uni-potsdam.de>

[Apologies for cross-posting. Please redistribute within your own group or among colleagues, thank you!]

In recent years we have experienced an exponential increase of knowledge available on the web. Having such an extensive amount of information poses a challenge when trying to identify globally relevant or important facts. In effort to address this issue, several fact ranking systems have already been developed. However, the difficulty with current state-of-the-art systems is that there is no gold standard corpus which could serve as a ground truth for evaluating their performances.

We have developed a fun and exciting quiz which will help us to tackle this issue by using the wisdom of the crowd. While you are playing, your inputs (which are greatly appreciated) will contribute to our scientific experiment. Together, we will build a first corpus that will help our scientific community in evaluating different fact ranking strategies!

Here you will find our tool<http://s16a.org/fr/> that is used to rank facts about ~500 popular entities from Wikipedia.

You have to register with the tool and then the task will be explained to you in detail. You might interrupt your rating of the presented facts any time you like and continue later. To make it a bit more interesting, you will be able to score points and see your ranking in a highscore list.

We would really appreciate your help in this task. Please do also spread the word. The more participants, the more valid our ground truth will be.

Thanks and best regards,

Semantic Technologies Team

Hasso-Plattner-Institut für Softwaresystemtechnik GmbH
Prof.-Dr.-Helmert-Str. 2-3
D-14482 Potsdam
Received on Thursday, 14 August 2014 10:17:04 UTC

This archive was generated by hypermail 2.4.0 : Tuesday, 5 July 2022 08:45:38 UTC