Towards Making the Most of Dialogue Characteristics for Neural Chat Translation
Not on the map. Why?
Abstract (arXiv)
Neural Chat Translation (NCT) aims to translate conversational text between speakers of different languages. Despite the promising performance of sentence-level and context-aware neural machine translation models, there still remain limitations in current NCT models because the inherent dialogue characteristics of chat, such as dialogue coherence and speaker personality, are neglected. In this paper, we propose to promote the chat translation by introducing the modeling of dialogue characteristics into the NCT model. To this end, we design four auxiliary tasks including monolingual response generation, cross-lingual response generation, next utterance discrimination, and speaker identification. Together with the main chat translation task, we optimize the NCT model through the training objectives of all these tasks. By this means, the NCT model can be enhanced by capturing the inherent dialogue characteristics, thus generating more coherent and speaker-relevant translations. Comprehensive experiments on four language directions (English-German and English-Chinese) verify the effectiveness and superiority of the proposed approach.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 40 of its 68 references that are in the map. First posted on arXiv 2 Sep 2021.
Builds on
40 of 68 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2019Taskmaster-1: Toward a Realistic and Diverse Dialog Datasetcited by 139
- 2019Bridging the Gap between Training and Inference for Neural Machine Translationcited by 123
- 2018Achieving Human Parity on Automatic Chinese to English News Translationcited by 119
- 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
28 more
- 2017Neural Machine Translation with Extended Contextcited by 95
- 2018Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluationcited by 88
- 2017Evaluating Discourse Phenomena in Neural Machine Translationcited by 87
- 2018Document-Level Neural Machine Translation with Hierarchical Attention Networkscited by 85
- 2020GRADE: Automatic Graph-Enhanced Coherence Metric for Evaluating Open-Domain Dialogue Systemscited by 76
- 2018Improving the Transformer Translation Model with Document-Level Contextcited by 74
- 2019Selective Attention for Context-aware Neural Machine Translationcited by 60
- 2018Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translationcited by 58
- 2017Exploiting Cross-Sentence Context for Neural Machine Translationcited by 48
- 2017Document Context Neural Machine Translation with Memory Networkscited by 41
- 2019Context-Aware Monolingual Repair for Neural Machine Translationcited by 41
- 2017Learning to Remember Translation History with a Continuous Cachecited by 39
- 2017Does Neural Machine Translation Benefit from Larger Context?cited by 38
- 2020Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translationcited by 34
- 2019Guiding Variational Response Generator to Exploit Personacited by 25
- 2020Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learningcited by 25
- 2021Modeling Bilingual Conversational Characteristics for Neural Chat Translationcited by 18
- 2018Contextual Neural Model for Translating Bilingual Multi-Speaker Conversationscited by 15
- 2018Modeling Coherence for Discourse Neural Machine Translationcited by 15
- 2019One Model to Learn Both: Zero Pronoun Prediction and Translationcited by 14
- 2020Learning a Simple and Effective Model for Multi-turn Response Generation with Auxiliary Taskscited by 14
- 2018DTMT: A Novel Deep Transition Architecture for Neural Machine Translationcited by 13
- 2020Multi-Unit Transformers for Neural Machine Translationcited by 13
- 2020Modeling Discourse Structure for Document-level Neural Machine Translationcited by 11
- 2016Automatic Construction of Discourse Corpora for Dialogue Translationcited by 10
- 2021Towards User-Driven Neural Machine Translationcited by 10
- 2021Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translationcited by 8
- 2020Document-aligned Japanese-English Conversation Parallel Corpuscited by 7
Built on by
Citing papers per year: 2022: 5; 2023: 4; 2024: 3.
12 papers.
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
- 2022MSCTD: A Multimodal Sentiment Chat Translation Datasetcited by 15
- 2023Towards Understanding and Improving Knowledge Distillation for Neural Machine Translationcited by 10
- 2022Scheduled Multi-task Learning for Neural Chat Translationcited by 7
- 2023Towards Speech Dialogue Translation Mediating Speakers of Different Languagescited by 4
- 2024Born With a Silver Spoon? Investigating Socioeconomic Bias in Large Language Modelscited by 4
- 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translationcited by 3
- 2022BJTU-WeChat's Systems for the WMT22 Chat Translation Taskcited by 1
- 2022A Major Obstacle for NLP Research: Let's Talk about Time Allocation!cited by 1
- 2023Context-aware Neural Machine Translation for English-Japanese Business Scene Dialoguescited by 1
- 2024An Investigation of Warning Erroneous Chat Translations in Cross-lingual Communicationcited by 1
- 2023Unified Model Learning for Various Neural Machine Translationcited by 0
- 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translation29 Aug 2024
- 2024An Investigation of Warning Erroneous Chat Translations in Cross-lingual Communication28 Aug 2024
- 2024Born With a Silver Spoon? Investigating Socioeconomic Bias in Large Language Models16 Feb 2024
- 2023Context-aware Neural Machine Translation for English-Japanese Business Scene Dialogues20 Nov 2023
- 2023Towards Speech Dialogue Translation Mediating Speakers of Different Languages16 May 2023
- 2023Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation14 May 2023
- 2023Unified Model Learning for Various Neural Machine Translation4 May 2023
- 2022A Major Obstacle for NLP Research: Let's Talk about Time Allocation!30 Nov 2022
- 2022BJTU-WeChat's Systems for the WMT22 Chat Translation Task28 Nov 2022
- 2022Scheduled Multi-task Learning for Neural Chat Translation8 May 2022
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarization8 Mar 2022
- 2022MSCTD: A Multimodal Sentiment Chat Translation Dataset28 Feb 2022