- From: Nandana Mihindukulasooriya <nandana.cse@gmail.com>
- Date: Wed, 7 Sep 2022 18:32:34 +0200
- To: undisclosed-recipients:;
- Message-ID: <CAAOEr1nXMy4PoWNMYS-X5ha2Ebc6B+ROLavcruOpGBdXTaYF+w@mail.gmail.com>
SMART2022 - Subtasks for Question Answering over Knowledge Graphs ISWC 2022 Semantic Web Challenge [https://iswc2022.semanticweb.org/] *Brief Background* Knowledge Base Question Answering (KBQA) is a popular task in the field of Natural Language Processing and Information Retrieval, in which the goal is to answer a natural language question using the facts in a Knowledge Base. KBQA can involve several subtasks such as entity linking, relation linking, and answer type prediction. In the SMART 2022 Semantic Web Challenge, we focus on evaluating modules for three subtasks in KBQA: Entity Linking, Relation Linking and Answer Type Prediction. *************************************************** Website: https://smart-task.github.io/2022/ Datasets: https://github.com/smart-task/smart-2022-datasets/ Slack: https://smart-task-iswc.slack.com/ Conference date and location: 23 - 27 October 2022 (Virtual) Submission deadline: *September 16, 2022* **************************************************** *Task Descriptions* This year, in the third iteration of the SMART challenge, we have three independent tasks: Task 1 - Answer Type Prediction: Given a question in natural language, the task is to predict the type of the answer using a set of candidates from a target ontology. * Which languages were influenced by Perl? -> dbo:ProgrammingLanguage or wd:Q9143 * How many employees does IBM have? -> number Task 2 - Relation Linking: Given a question in natural language, the task is to predict the relations needed to extract the correct answer from the KB. * Who are the actors starring in movies directed by and starring William Shatner? -> dbo:starring, dbo:director or cast member (P161), director (P57) * What games can be played in schools founded by Fr. Orlando? -> dbo:sport, dbo:foundedBy or founded by (P112), sport (P641) Task 3 - Entity Linking: Given a question in natural language, the task is to identify the entities and link them to the KG, so that those entities can be used for formulating the query. - Was Ganymede discovered by Galileo Galilei? -> [dbr:Ganymede_(moon), dbr:Galileo_Galilei] - Where was richard sprigg steuart born? -> [wd:Q7329193(Richard Sprigg Steuart)] *Datasets* We have created four datasets for each task, each KB; SMART-2022-AT (DBpedia and Wikidata) and SMART-2022-RL (DBpedia and Wikidata), SMART2022-EL (DBpedia and Wikidata). Participants can compete in all or any combination of these six datasets. *Submissions and publication* The participants are supposed to send their system outputs by the deadline. Participants can submit a system paper that will be peer-reviewed and published in a CEUR volume similar to the last two years - http://ceur-ws.org/Vol-2774/ and http://ceur-ws.org/Vol-3119/. Please join the slack workspace and contact the organizers regarding any inquiries related to the task, datasets, and submissions. We are looking forward to your submissions! *Organizers* Nandana Mihindukulasooriya, IBM Research AI Mohnish Dubey, Philips Research Alfio Gliozzo, IBM Research AI Jens Lehmann, Amazon Axel-Cyrille Ngonga Ngomo, Paderborn University Ricardo Usbeck, University of Hamburg Gaetano Rossiello, IBM Research AI Debayan Banerjee, University of Hamburg
Received on Wednesday, 7 September 2022 16:32:59 UTC