[CFP] 1st Call for Participation - ISWC-LLMs4OL 2024 Challenge: Large Language Models for Ontology Learning

 Dear colleagues and friends,

*We are pleased to release the 1st Call for Participation - LLMs4OL
Challenge collocated with The International Semantic Web Conference (ISWC
2024)*

*Overview:* LLMs4OL stands for "Large Language Models for Ontology
Learning." The LLMs4OL paradigm was first introduced in our research paper (
https://link.springer.com/chapter/10.1007/978-3-031-47240-4_22) published
in the ISWC 2023 main conference proceedings. In this context, we aimed to
test the readiness of LLMs to address the Ontology Learning (OL) task
w.r.t. three main subtasks: 1) Term Typing, 2) Type Taxonomy Discovery, and
3) Non-Taxonomic Relation Extraction. Therein our evaluations included
ontolgies from various knowledge domains, i.e. lexicosemantics (WordNet),
geography (GeoNames), biomedicine (NCI, MEDICIN, SNOMEDCT), and web content
types (schema.org). With the ISWC-LLMs4OL 2024 challenge, we aim to
catalyze community-wide engagement in validating and expanding the use of
LLMs in OL by releasing our evaluation datasets publicly in the community.
This initiative is poised to advance our comprehension of LLMs’ roles
within the Semantic Web, encouraging innovation and collaboration in
developing scalable and accurate OL methods.

More info on the task website: https://sites.google.com/view/llms4ol/

The LLMs4OL Challenge will be divided into two evaluation phases:

- Evaluation Phase 1: Few-shot Testing;
- Evaluation Phase 2: Zero-shot Testing

*Dates*

Training datasets available: March 30, 2024
Test data available (Task A): May 27, 2024
Evaluation ends (Task A): June 4, 2024
Test data available (Tasks B & C): June 5, 2024
Evaluation ends (Tasks B & C): June 18, 2024
Participant papers due: June 28, 2024
Notification to authors: July 19, 2024
Camera ready due: July 30, 2024
ISWC 2024, Baltimore, Maryland, USA: 11-15 November 2024

*Task Organizers*

Hamed Babaei Giglou (TIB Leibniz Information Centre for Science and
Technology - Germany)
Jennifer D’Souza (TIB Leibniz Information Centre for Science and Technology
- Germany)
Sören Auer (TIB Leibniz Information Centre for Science and Technology -
Germany)

We look forward to having you on board!

*Contact:* llms4ol.challenge [at] gmail.com