Challenge Announcement: ENSEC - ENtity Summarization Evaluation Campaign

[Apologies for cross-posting]


Call for Participation
--------------------
The 2016 ENtity Summarization Evaluation Campaign (ENSEC 2016)
co-located with the SumPre 2016 workshop


http://km.aifb.kit.edu/ws/sumpre2016/challenge.html


The volume of entity-centric data is rapidly increasing on the Web, 
including RDF and Linked Data, Schema.org, Facebook’s Open Graph, and 
Google’s Knowledge Graph, describing entities (e.g., directors and 
films) and relations between them (e.g., directs). The description of an 
entity, consisting of a set of entity-property-value triples, is 
sometimes too long to be entirely presented to a user. As a substitute, 
a compact summary can be shown to help the user efficiently while 
effectively perform a task (e.g., browsing, searching).


Specifically, an entity summary is a subset of entity-property-value 
triples selected from the description of an entity. Entity summarization 
is the task of automatically generating a high-quality entity summary, 
to be used for a specific task or for general purposes. Whereas several 
preliminary solutions have been proposed [1][2][3], the problem is still 
far from being solved. Therefore, this ENtity Summarization Evaluation 
Campaign (ENSEC) is organized to assess strengths and weaknesses of 
entity summarization systems, compare performance of techniques, and 
enhance communication among researchers and developers.


ENSEC-2016, co-located with the SumPre 2016 workshop, consists of two 
tracks: the DBpedia-50 track and the LinkedMDB-30 track. A system can 
participate either or both tracks, by submitting summaries it generates 
for a set of specified entities. The results will be evaluated against 
gold-standard entity summaries given by human experts.


Winners and runner-ups will share Amazon vouchers in a total value of 
350 Euros, sponsored by the SumOn project.


For details about the campaign, please see 
http://km.aifb.kit.edu/ws/sumpre2016/challenge.html.


IMPORTANT DATES
--------------------
* Release of test entities: March 8, 2016
* Submission of entity summaries: April 8, 2016 (Hawaii Time)
* Submission of system papers: April 15, 2016 (Hawaii Time)
* Release of evaluation results: May 15, 2016
* Workshop: May 30, 2016

  ORGANIZERS
  --------------------
  * Gong Cheng, Nanjing University, China
  * Kalpa Gunaratna, (Kno.e.sis) Wright State University, USA
  * Andreas Thalhammer, Karlsruhe Institute of Technology (KIT), Germany


CONTACT
--------------------
* ensec2016@gmail.com


REFERENCES
--------------------
[1] Gong Cheng, Thanh Tran, Yuzhong Qu. RELIN: Relatedness and 
Informativeness-based Centrality for Entity Summarization. In 
Proceedings of the 10th International Semantic Web Conference (ISWC'11), 
Part I, pages 114--129, 2011.
[2] Andreas Thalhammer, Ioan Toma, Antonio J. Roa-Valverde, Dieter 
Fensel. Leveraging Usage Data for Linked Data Movie Entity 
Summarization. In Proceedings of the 2nd International Workshop on Usage 
Analysis and the Web of Data (USEWOD’12), 2012.
[3] Kalpa Gunaratna, Krishnaprasad Thirunarayan, Amit Sheth. FACES: 
Diversity-Aware Entity Summarization Using Incremental Hierarchical 
Conceptual Clustering. In Proceedings of the 29th AAAI Conference on 
Artificial Intelligence (AAAI’15), pages 116--122, 2015.