CLEF-2025 CheckThat! Lab -- 2nd Call for Participation

(apologies for cross-posting)


Dear colleague,


We invite you to participate in the 2025 edition of the CheckThat! Lab at CLEF 2025. This year, we feature four tasks ---one follow-up and three new--- that correspond to important components within and around the full fact-checking pipeline in multiple languages:


Task 1 Subjectivity in news articles. to spot text that should be processed with specific strategies; benefiting the fact-checking pipeline. Available in Arabic, English, Bulgarian,  German, Italian, and Multilingual.


Task 2 Claim Normalization. to simplify the primary claim made in the social media post into a concise form. This task is offered in 20 languages: English, Arabic, Bengali, Czech, German, Greek, French, Hindi, Korean, Marathi, Indonesian, Dutch, Punjabi, Polish, Portuguese, Romanian, Spanish, Tamil, Telugu, Thai.


Task 3 Fact-Checking Numerical Claims. to verify claims with numerical quantities and temporal expressions. Available in Arabic, English and Spanish.


Task 4 Scientific Web Discourse Processing (SciWeb). to (a) classify different forms of science-related online discourse and (b) retrieve the scientific paper that serves as the source for the claim from a given pool of candidate scientific papers. Available in English.




Register and participate: https://clef2025-labs-registration.dei.unipd.it/registrationForm.php

Further information: https://checkthat.gitlab.io/

Datasets: https://gitlab.com/checkthat_lab/clef2025-checkthat-lab



Important Dates

---------------------

- November 2024: Lab registration opens

- December 2024: Release of the training materials

- 25 April 2025: Lab registration closes

- 30 April 2025: Beginning of the evaluation cycle (test sets release)

- 10 May 2025 (23:59 AOE): End of the evaluation cycle (run submission)

- 30 May 2025: Deadline for the submission of working notes [CEUR-WS]

- 30 May - 27 June 2025: Review process of participant papers

- 9 June 2025: Submission of Condensed Lab Overviews [LNCS]

- 16 June 2025: Notification of Acceptance for Condensed Lab Overviews [LNCS]

- 23 June 2025: Camera Ready Copy of Condensed Lab Overviews [LNCS] due

- 27 June 2025: Notification of Acceptance for Participant Papers [CEUR-WS]

- 7 July 2025: Camera Ready Copy of Participant Papers and Extended Lab Overviews [CEUR-WS] due

- 21-25 July 2025: CEUR-WS Working Notes Preview for Checking by Authors and Lab Organizers

- 9-12 September 2025: CLEF 2025 Conference in Madrid, Spain


Best regards,

The CLEF-2025 CheckThat! Lab Shared Task Organizers




Dr. Dimitar Dimitrov

Head of team Information Extraction & Linking

KTS / Information Extraction & Linking


[cid:image002.png@01DB6B5C.B737C3D0]<https://www.gesis.org/en/home>

Unter Sachsenhausen 6-8 | 50667 Köln

+49 (0) 221 47694 512

dimitar.dimitrov@gesis.org<mailto:dimitar.dimitrov@gesis.org>



[Ein Bild, das Symbol, Logo, Schrift, Grafiken enthält.  Automatisch generierte Beschreibung]<https://www.facebook.com/gesis.org/>   [Ein Bild, das Screenshot, Reihe, Electric Blue (Farbe), Grafiken enthält.  Automatisch generierte Beschreibung] <https://twitter.com/gesis_org>    [Ein Bild, das Logo, Grafiken, Kreis, Screenshot enthält.  Automatisch generierte Beschreibung] <https://www.linkedin.com/shareArticle?mini=true&url=https%3A%2F%2Fwww.gesis.org%2Fhome&title=Home&summary=Home&source=https%3A%2F%2Fwww.gesis.org%2Fhome>    [Ein Bild, das Kreis, Grafiken, Design enthält.  Automatisch generierte Beschreibung] <https://www.instagram.com/gesis_lifs/?igshid=12x9jh7rglo97>    [Ein Bild, das Schrift, Grafiken, Logo, Text enthält.  Automatisch generierte Beschreibung] <https://www.youtube.com/user/GESIStv>    [Ein Bild, das Grafiken, Kreis, Symbol, Logo enthält.  Automatisch generierte Beschreibung] <https://blog.gesis.org/>


You can find our information on data protection under https://www.gesis.org/en/institute/data-protection