mlsanityData to 14 Oct 2026

Modeling Bilingual Conversational Characteristics for Neural Chat Translation

arXiv 2107.11164 ↗First posted 23 Jul 2021cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

Neural chat translation aims to translate bilingual conversational text, which has a broad application in international exchanges and cooperation. Despite the impressive performance of sentence-level and context-aware Neural Machine Translation (NMT), there still remain challenges to translate bilingual conversational text due to its inherent characteristics such as role preference, dialogue coherence, and translation consistency. In this paper, we aim to promote the translation quality of conversational text by modeling the above properties. Specifically, we design three latent variational modules to learn the distributions of bilingual conversational characteristics. Through sampling from these learned distributions, the latent variables, tailored for role preference, dialogue coherence, and translation consistency, are incorporated into the NMT model for better translation. We evaluate our approach on the benchmark dataset BConTrasT (English-German) and a self-collected bilingual dialogue corpus, named BMELD (English-Chinese). Extensive experiments show that our approach notably boosts the performance over strong baselines by a large margin and significantly surpasses some state-of-the-art context-aware NMT models in terms of BLEU and TER. Additionally, we make the BMELD dataset publicly available for the research community.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 39 of its 75 references that are in the map. First posted on arXiv 23 Jul 2021.

Builds on

39 of 75 references.

References · 39

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  5. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  7. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  8. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  9. 2017Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoderscited by 222
  10. 2019Taskmaster-1: Toward a Realistic and Diverse Dialog Datasetcited by 140
  11. 2019Bridging the Gap between Training and Inference for Neural Machine Translationcited by 123
  12. 2018Achieving Human Parity on Automatic Chinese to English News Translationcited by 119
27 more
  1. 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
  2. 2017Neural Machine Translation with Extended Contextcited by 95
  3. 2018Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluationcited by 88
  4. 2017Evaluating Discourse Phenomena in Neural Machine Translationcited by 87
  5. 2018Document-Level Neural Machine Translation with Hierarchical Attention Networkscited by 85
  6. 2018Improving the Transformer Translation Model with Document-Level Contextcited by 74
  7. 2019Selective Attention for Context-aware Neural Machine Translationcited by 60
  8. 2018Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translationcited by 58
  9. 2017Exploiting Cross-Sentence Context for Neural Machine Translationcited by 48
  10. 2017Document Context Neural Machine Translation with Memory Networkscited by 41
  11. 2019Context-Aware Monolingual Repair for Neural Machine Translationcited by 41
  12. 2017Learning to Remember Translation History with a Continuous Cachecited by 39
  13. 2017Does Neural Machine Translation Benefit from Larger Context?cited by 38
  14. 2016Variational Neural Machine Translationcited by 35
  15. 2020Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translationcited by 34
  16. 2019Guiding Variational Response Generator to Exploit Personacited by 25
  17. 2020Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learningcited by 25
  18. 2018Variational Recurrent Neural Machine Translationcited by 23
  19. 2018Contextual Neural Model for Translating Bilingual Multi-Speaker Conversationscited by 15
  20. 2018Modeling Coherence for Discourse Neural Machine Translationcited by 15
  21. 2019One Model to Learn Both: Zero Pronoun Prediction and Translationcited by 14
  22. 2018DTMT: A Novel Deep Transition Architecture for Neural Machine Translationcited by 13
  23. 2020Multi-Unit Transformers for Neural Machine Translationcited by 13
  24. 2016Automatic Construction of Discourse Corpora for Dialogue Translationcited by 10
  25. 2021Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translationcited by 8
  26. 2020Document-aligned Japanese-English Conversation Parallel Corpuscited by 7
  27. 2016Neural Machine Translation with Latent Semantic of Image and Textcited by 3

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 7; 2023: 6; 2024: 3; 2025: 1.

18 papers.

Sort:

By area:

  1. 2022ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarizationcited by 25
  2. 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
  3. 2022MSCTD: A Multimodal Sentiment Chat Translation Datasetcited by 15
  4. 2021Towards Making the Most of Dialogue Characteristics for Neural Chat Translationcited by 12
  5. 2023Towards Understanding and Improving Knowledge Distillation for Neural Machine Translationcited by 10
  6. 2022Conversational Speech Recognition By Learning Conversation-level Characteristicscited by 8
  7. 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translationcited by 8
  8. 2022Scheduled Multi-task Learning for Neural Chat Translationcited by 7
  9. 2022P-Transformer: Towards Better Document-to-Document Neural Machine Translationcited by 5
  10. 2023Conversational Speech Recognition by Learning Audio-textual Cross-modal Contextual Representationcited by 4
  11. 2023A Multi-task Multi-stage Transitional Training Framework for Neural Chat Translationcited by 3
  12. 2023Chat Translation Error Detection for Assisting Cross-lingual Communicationscited by 3
6 more
  1. 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translationcited by 3
  2. 2024A Context-aware Framework for Translation-mediated Conversationscited by 2
  3. 2022BJTU-WeChat's Systems for the WMT22 Chat Translation Taskcited by 1
  4. 2023Context-aware Neural Machine Translation for English-Japanese Business Scene Dialoguescited by 1
  5. 2024An Investigation of Warning Erroneous Chat Translations in Cross-lingual Communicationcited by 1
  6. 2023Unified Model Learning for Various Neural Machine Translationcited by 0