Findings of the Fourth Shared Task on Multilingual Coreference Resolution: Can LLMs Dethrone Traditional Approaches?
Not on the map. Why?
Abstract (arXiv)
The paper presents an overview of the fourth edition of the Shared Task on Multilingual Coreference Resolution, organized as part of the CODI-CRAC 2025 workshop. As in the previous editions, participants were challenged to develop systems that identify mentions and cluster them according to identity coreference. A key innovation of this year's task was the introduction of a dedicated Large Language Model (LLM) track, featuring a simplified plaintext format designed to be more suitable for LLMs than the original CoNLL-U representation. The task also expanded its coverage with three new datasets in two additional languages, using version 1.3 of CorefUD - a harmonized multilingual collection of 22 datasets in 17 languages. In total, nine systems participated, including four LLM-based approaches (two fine-tuned and two using few-shot adaptation). While traditional systems still kept the lead, LLMs showed clear potential, suggesting they may soon challenge established approaches in future editions.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 13 of its 54 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
13 of 54 references.
References · 13
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2017End-to-end Neural Coreference Resolutioncited by 241
- 2019An Annotated Dataset of Coreference in English Literaturecited by 58
- 2021Word-Level Coreference Resolutioncited by 40
- 2023Are Large Language Models Robust Coreference Resolvers?cited by 15
- 2021Multilingual Coreference Resolution with Harmonized Annotationscited by 13
- 2022Findings of the Shared Task on Multilingual Coreference Resolutioncited by 13
- 2020Prague Dependency Treebank -- Consolidated 1.0cited by 11
- 2023CAW-coref: Conjunction-Aware Word-level Coreference Resolutioncited by 10
- 2024Findings of the Third Shared Task on Multilingual Coreference Resolutioncited by 10
- 2024[Lions: 1] and [Tigers: 2] and [Bears: 3], Oh My! Literary Coreference Annotation with LLMscited by 8
- 2024CorPipe at CRAC 2024: Predicting Zero Mentions from Raw Textcited by 6
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Findings of the Fifth Shared Task on Multilingual Coreference Resolution: Expanding Datasets for Long-Range Entitiescited by 1
- 2026Closing the Gap at CRAC 2026: Two-Stage Adaptation for LLM-Based Multilingual Coreference Resolutioncited by 0
- 2026CorPipe at CRAC 2026: Empty Nodes and Cross-Lingual Transfer in Multilingual Coreference Resolutioncited by 0
- 2026Multilingual Coreference Resolution via Cycle-Consistent Machine Translationcited by 0
- 2026Human-Like Anaphor Resolution in Large Language Modelscited by 0
- 2026Worth Their Weights? Evaluating Generative Models for Discourse Parsingcited by 0
- 2026Worth Their Weights? Evaluating Generative Models for Discourse Parsing13 Oct 2026
- 2026Human-Like Anaphor Resolution in Large Language Models6 Aug 2026
- 2026Multilingual Coreference Resolution via Cycle-Consistent Machine Translation3 Jun 2026
- 2026CorPipe at CRAC 2026: Empty Nodes and Cross-Lingual Transfer in Multilingual Coreference Resolution28 May 2026
- 2026Findings of the Fifth Shared Task on Multilingual Coreference Resolution: Expanding Datasets for Long-Range Entities20 May 2026
- 2026Closing the Gap at CRAC 2026: Two-Stage Adaptation for LLM-Based Multilingual Coreference Resolution16 May 2026