Context-Aware Machine Translation with Source Coreference Explanation
Not on the map. Why?
Abstract (arXiv)
Despite significant improvements in enhancing the quality of translation, context-aware machine translation (MT) models underperform in many cases. One of the main reasons is that they fail to utilize the correct features from context when the context is too long or their models are overly complex. This can lead to the explain-away effect, wherein the models only consider features easier to explain predictions, resulting in inaccurate translations. To address this issue, we propose a model that explains the decisions made for translation by predicting coreference features in the input. We construct a model for input coreference by exploiting contextual features from both the input and translation output representations on top of an existing MT model. We evaluate and analyze our method in the WMT document-level translation task of English-German dataset, the English-Russian dataset, and the multilingual TED talk dataset, demonstrating an improvement of over 1.0 BLEU score when compared with other context-aware models.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 44 of its 64 references that are in the map. First posted on arXiv 30 Apr 2024.
Builds on
44 of 64 references.
References · 44
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2020The Pitfalls of Simplicity Bias in Neural Networkscited by 351
32 more
- 2017End-to-end Neural Coreference Resolutioncited by 241
- 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
- 2018When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?cited by 126
- 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
- 2017Neural Machine Translation with Extended Contextcited by 95
- 2015Multi-task Sequence to Sequence Learningcited by 94
- 2023Document-Level Machine Translation with Large Language Modelscited by 90
- 2019Selective Attention for Context-aware Neural Machine Translationcited by 60
- 2024Adapting Large Language Models for Document-Level Machine Translationcited by 59
- 2018VnCoreNLP: A Vietnamese Natural Language Processing Toolkitcited by 51
- 2022Neural networks trained with SGD learn distributions of increasing complexitycited by 50
- 2017Exploiting Cross-Sentence Context for Neural Machine Translationcited by 48
- 2021G-Transformer for Document-level Machine Translationcited by 46
- 2021Coreference Resolution without Span Representationscited by 45
- 2017Learning to Remember Translation History with a Continuous Cachecited by 39
- 2016Linguistic Input Features Improve Neural Machine Translationcited by 38
- 2017Does Neural Machine Translation Benefit from Larger Context?cited by 38
- 2019Simple and Effective Noisy Channel Modeling for Neural Machine Translationcited by 37
- 2020Rethinking Document-level Neural Machine Translationcited by 32
- 2020Long-Short Term Masking Transformer: A Simple but Effective Baseline for Document-level Neural Machine Translationcited by 27
- 2019Enhancing Machine Translation with Dependency-Aware Self-Attentioncited by 24
- 2016The Neural Noisy Channelcited by 19
- 2017Learning to Parse and Translate Improves Neural Machine Translationcited by 16
- 2022Learn To Remember: Transformer with Recurrent Memory for Document-Level Machine Translationcited by 16
- 2018Modeling Coherence for Discourse Neural Machine Translationcited by 15
- 2024Enhancing Document-level Translation of Large Language Model via Translation Mixed-instructionscited by 13
- 2020Document Graph for Neural Machine Translationcited by 12
- 2017Exploiting Linguistic Resources for Neural Machine Translation Using Multi-task Learningcited by 11
- 2021Contrastive Learning for Context-aware Neural Machine TranslationUsing Coreference Informationcited by 9
- 2020Capturing document context inside sentence-level neural machine translation models with self-trainingcited by 7
- 2023Target-Side Augmentation for Document-Level Machine Translationcited by 5
- 2022Multilingual Coreference Resolution in Multiparty Dialoguecited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.