- From: W3C Community Development Team <team-community-process@w3.org>
- Date: Thu, 26 Jan 2017 09:43:57 +0000
- To: public-nli@w3.org
Call for Systems QALD2017 CHALLENGE @ ESWC 2017 ESWC 2017, May 28th, 2016 to June 1st, 2017 Portoroz, Slovenia. https://project-hobbit.eu/challenges/qald2017/ The key challenge for Question Answering over Linked Data is to translate a user’s information need into a form such that it can be evaluated using standard Semantic Web query processing and inferencing techniques. The main task of QALD therefore is the following: Given one or several RDF dataset(s) as well as additional knowledge sources and natural language questions or keywords, return the correct answers or a SPARQL query that retrieves these answers. In order to focus on specific aspects and challenges, we propose the following three tasks: Task 1: Multilingual question answering over DBpedia Task 2: Hybrid question answering Task 3: Large-Scale question answering over RDF Task 4: Wikidata-based question answering Submission The QALD challenge provides an automatic evaluation tool (GERBIL QA integrated into the HOBBIT platform) that is open source and available for everyone to re-use. This tool is accessible online, so that participants can simply upload the answers produced by their system or even check their system via a web service. Each experiment will have a citable, time-stable and archivable URI which is both human- and machine-readable. It is mandatory for each system to provide an endpoint URL wrapped inside a provided Docker container after the submission in order to be evaluated with GERBIL QA. We are accepting papers (up to 5 pages) describing the submitted approach and evaluation results. Submissions must be in English and in PDF, formatted in the style of the Springer Publications format for Lecture Notes in Computer Science (LNCS). Papers should be submitted through the EasyChair system (https://easychair.org/conferences/?conf=qald2017) no later than midnight Friday March 10th, 2017, Hawaii Time. Submissions will be reviewed by members of the challenge program committee. Papers will be evaluated according to their significance, originality, technical content, style, clarity, and relevance to the challenge. The complete set of papers will be published with the CEUR Workshop Proceedings (CEUR-WS.org), listed by the DBLP. For any questions, please write an email to Ricardo Usbeck (usbeck AT informatik.uni-leipzig.de). Preliminary Schedule Release of training data and instructions: Friday January 13th, 2017 Release of test dataset: Friday April 7th, 2017 Paper submission deadline: Friday March 10th, 2017 Challenge paper reviews: Tuesday April 5th, 2017 Paper Notifications and invitation to task: Friday April 7th, 2017 Camera ready papers (5 pages document): Sunday April 23rd, 2017 Submission of camera-ready papers: April 24, 2014 ---------- This post sent on Natural Language Interfaces for the Web of Data Community Group '' https://www.w3.org/community/nli/2017/01/26/38/ Learn more about the Natural Language Interfaces for the Web of Data Community Group: https://www.w3.org/community/nli
Received on Thursday, 26 January 2017 09:44:04 UTC