mlsanityData to 14 Oct 2026

Context-Aware Machine Translation with Source Coreference Explanation

arXiv 2404.19505 ↗First posted 30 Apr 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Despite significant improvements in enhancing the quality of translation, context-aware machine translation (MT) models underperform in many cases. One of the main reasons is that they fail to utilize the correct features from context when the context is too long or their models are overly complex. This can lead to the explain-away effect, wherein the models only consider features easier to explain predictions, resulting in inaccurate translations. To address this issue, we propose a model that explains the decisions made for translation by predicting coreference features in the input. We construct a model for input coreference by exploiting contextual features from both the input and translation output representations on top of an existing MT model. We evaluate and analyze our method in the WMT document-level translation task of English-German dataset, the English-Russian dataset, and the multilingual TED talk dataset, demonstrating an improvement of over 1.0 BLEU score when compared with other context-aware models.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 44 of its 64 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

44 of 64 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  5. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  6. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  7. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  8. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  9. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
  10. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  11. 2017Convolutional Sequence to Sequence Learningcited by 552
  12. 2020The Pitfalls of Simplicity Bias in Neural Networkscited by 351
32 more
  1. 2017End-to-end Neural Coreference Resolutioncited by 241
  2. 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
  3. 2018When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?cited by 126
  4. 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
  5. 2017Neural Machine Translation with Extended Contextcited by 95
  6. 2015Multi-task Sequence to Sequence Learningcited by 94
  7. 2023Document-Level Machine Translation with Large Language Modelscited by 90
  8. 2019Selective Attention for Context-aware Neural Machine Translationcited by 60
  9. 2024Adapting Large Language Models for Document-Level Machine Translationcited by 59
  10. 2018VnCoreNLP: A Vietnamese Natural Language Processing Toolkitcited by 51
  11. 2022Neural networks trained with SGD learn distributions of increasing complexitycited by 50
  12. 2017Exploiting Cross-Sentence Context for Neural Machine Translationcited by 48
  13. 2021G-Transformer for Document-level Machine Translationcited by 46
  14. 2021Coreference Resolution without Span Representationscited by 45
  15. 2017Learning to Remember Translation History with a Continuous Cachecited by 39
  16. 2016Linguistic Input Features Improve Neural Machine Translationcited by 38
  17. 2017Does Neural Machine Translation Benefit from Larger Context?cited by 38
  18. 2019Simple and Effective Noisy Channel Modeling for Neural Machine Translationcited by 37
  19. 2020Rethinking Document-level Neural Machine Translationcited by 32
  20. 2020Long-Short Term Masking Transformer: A Simple but Effective Baseline for Document-level Neural Machine Translationcited by 27
  21. 2019Enhancing Machine Translation with Dependency-Aware Self-Attentioncited by 24
  22. 2016The Neural Noisy Channelcited by 19
  23. 2017Learning to Parse and Translate Improves Neural Machine Translationcited by 16
  24. 2022Learn To Remember: Transformer with Recurrent Memory for Document-Level Machine Translationcited by 16
  25. 2018Modeling Coherence for Discourse Neural Machine Translationcited by 15
  26. 2024Enhancing Document-level Translation of Large Language Model via Translation Mixed-instructionscited by 13
  27. 2020Document Graph for Neural Machine Translationcited by 12
  28. 2017Exploiting Linguistic Resources for Neural Machine Translation Using Multi-task Learningcited by 11
  29. 2021Contrastive Learning for Context-aware Neural Machine TranslationUsing Coreference Informationcited by 9
  30. 2020Capturing document context inside sentence-level neural machine translation models with self-trainingcited by 7
  31. 2023Target-Side Augmentation for Document-Level Machine Translationcited by 5
  32. 2022Multilingual Coreference Resolution in Multiparty Dialoguecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.