mlsanityData to 7 Oct 2026

Light Coreference Resolution for Russian with Hierarchical Discourse Features

arXiv 2306.01465 ↗First posted 2 Jun 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Coreference resolution is the task of identifying and grouping mentions referring to the same real-world entity. Previous neural models have mainly focused on learning span representations and pairwise scores for coreference decisions. However, current methods do not explicitly capture the referential choice in the hierarchical discourse, an important factor in coreference resolution. In this study, we propose a new approach that incorporates rhetorical information into neural coreference resolution models. We collect rhetorical features from automated discourse parses and examine their impact. As a base model, we implement an end-to-end span-based coreference resolver using a partially fine-tuned multilingual entity-aware language model LUKE. We evaluate our method on the RuCoCo-23 Shared Task for coreference resolution in Russian. Our best model employing rhetorical distance between mentions has ranked 1st on the development set (74.6% F1) and 2nd on the test set (73.3% F1) of the Shared Task. We hope that our work will inspire further research on incorporating discourse information in neural coreference resolution models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 2 Jun 2023.

Builds on

11 of 23 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  3. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  4. 2017End-to-end Neural Coreference Resolutioncited by 240
  5. 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
  6. 2020Revealing the Myth of Higher-Order Inference in Coreference Resolutioncited by 49
  7. 2021Coreference Resolution without Span Representationscited by 45
  8. 2021Word-Level Coreference Resolutioncited by 40
  9. 2021mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Modelscited by 19
  10. 2021Evaluating the Impact of a Hierarchical Discourse Representation on Entity Coreference Resolution Performancecited by 2
  11. 2022RuCoCo: a new Russian corpus with coreference annotationcited by 2

Built on by

Not cited yet.