W3C home > Mailing lists > Public > public-lod@w3.org > August 2012

GWAP: Evaluating Summaries

From: Andreas Thalhammer <andreas.thalhammer@sti2.at>
Date: Wed, 22 Aug 2012 13:39:34 +0200
Message-ID: <5034C4F6.7070104@sti2.at>
To: public-lod community <public-lod@w3.org>, Semantic Web <semantic-web@w3.org>
Dear all,

We would like to invite you to try the latest creation of 
WhoKnows?Movies! [1]

WhoKnows?Movies! is a GWAP (game with a purpose) that asks quiz 
questions about famous movies. The data comes from Freebase. We also 
have a high score list which we will keep online for eternity (you can 
mention it in your CV)!

Game with a purpose - "but what actually is the purpose?":
Summarizing entities individually in accordance to the relevance of 
specific property-value pairs has gained focus of recent efforts by 
research (e.g. [2]) and also industry (e.g. [3]). Unfortunately, such 
summaries are hard to evaluate due to the lack of a gold standard. In 
our paper - accepted for this year's ISWC Experiments and Evaluation 
track - we address this issue with a GWAP. We have published a first 
(anonymized) excerpt of the data gathered via the game at [4]. However, 
such a dataset is never complete and we want to provide an enhanced 
version for the camera ready version of the paper. More information can 
be found on [5].

Kind Regards,

[1] http://j.mp/WhoKnowsMovies
[2] Gong Cheng, Thanh Tran and Yuzhong Qu. "RELIN: Relatedness and 
Informativeness-based Centrality for Entity Summarization" 
("2. Get the best summary")
[4] http://www.yovisto.com/labs/iswc2012/

Andreas Thalhammer
PhD Student
Semantic Technology Institute
University of Innsbruck

phone: +43 (0) 512507 6454
Received on Wednesday, 22 August 2012 11:40:10 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 7 January 2015 15:16:24 UTC