mlsanityData to 7 Oct 2026

'UFAL CorPipe at CRAC 2022: Effectivity of Multilingual Models for Coreference Resolution

arXiv 2209.07278 ↗First posted 15 Sep 2022cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

We describe the winning submission to the CRAC 2022 Shared Task on Multilingual Coreference Resolution. Our system first solves mention detection and then coreference linking on the retrieved spans with an antecedent-maximization approach, and both tasks are fine-tuned jointly with shared Transformer weights. We report results of fine-tuning a wide range of pretrained models. The center of this contribution are fine-tuned multilingual models. We found one large multilingual model with sufficiently large encoder to increase performance on all datasets across the board, with the benefit not limited only to the underrepresented languages or groups of typologically relative languages. The source code is available at https://github.com/ufal/crac2022-corpipe.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 18 of its 28 references that are in the map. First posted on arXiv 15 Sep 2022.

Builds on

18 of 28 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
  6. 2019CamemBERT: a Tasty French Language Modelcited by 368
  7. 2017End-to-end Neural Coreference Resolutioncited by 240
  8. 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
  9. 2020German's Next Language Modelcited by 144
  10. 2019BERT for Coreference Resolution: Baselines and Analysiscited by 125
  11. 2019Adaptation of Deep Bidirectional Multilingual Transformers for Russian Languagecited by 109
  12. 2020Rethinking embedding coupling in pre-trained language modelscited by 103
6 more
  1. 2021HerBERT: Efficiently Pretrained Transformer-based Language Model for Polishcited by 51
  2. 2020Revealing the Myth of Higher-Order Inference in Coreference Resolutioncited by 49
  3. 2021RobeCzech: Czech RoBERTa, a monolingual contextualized language representation modelcited by 33
  4. 2021Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalancited by 26
  5. 2021Multilingual Coreference Resolution with Harmonized Annotationscited by 13
  6. 2021Training dataset and dictionary sizes matter in BERT models: the case of Baltic languagescited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 1; 2024: 3; 2025: 2; 2026: 1.

8 papers.

  1. 2022Findings of the Shared Task on Multilingual Coreference Resolutioncited by 13
  2. 2024Findings of the Third Shared Task on Multilingual Coreference Resolutioncited by 10
  3. 2024CorPipe at CRAC 2024: Predicting Zero Mentions from Raw Textcited by 6
  4. 2024Exploring Multiple Strategies to Improve Multilingual Coreference Resolution in CorefUDcited by 3
  5. 2025CorPipe at CRAC 2025: Evaluating Multilingual Encoders for Multilingual Coreference Resolutioncited by 2
  6. 2023Investigating Multilingual Coreference Resolution by Universal Annotationscited by 0
  7. 2025Towards Generating Automatic Anaphora Annotationscited by 0
  8. 2026CorPipe at CRAC 2026: Empty Nodes and Cross-Lingual Transfer in Multilingual Coreference Resolutioncited by 0