Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translation
Not on the map. Why?
Abstract (arXiv)
Automatic translation of dialogue texts is a much needed demand in many real life scenarios. However, the currently existing neural machine translation delivers unsatisfying results. In this paper, we conduct a deep analysis of a dialogue corpus and summarize three major issues on dialogue translation, including pronoun dropping (droppro), punctuation dropping (droppun), and typos (typo). In response to these challenges, we propose a joint learning method to identify omission and typo, and utilize context to translate dialogue utterances. To properly evaluate the performance, we propose a manually annotated dataset with 1,931 Chinese-English parallel utterances from 300 dialogues as a benchmark testbed for dialogue translation. Our experiments show that the proposed method improves translation quality by 3.2 BLEU over the baselines. It also elevates the recovery rate of omitted pronouns from 26.09% to 47.16%. We will publish the code and dataset publicly at https://github.com/rgwt123/DialogueMT.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
19 of 30 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2017Synthetic and Natural Noise Both Break Neural Machine Translationcited by 304
- 2020Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Informationcited by 64
- 2019Towards Making the Most of BERT in Neural Machine Translationcited by 43
- 2019Improving Robustness of Machine Translation with Synthetic Noisecited by 36
7 more
- 2018Towards Robust Neural Machine Translationcited by 35
- 2018Contextual Neural Model for Translating Bilingual Multi-Speaker Conversationscited by 15
- 2018Translating Pro-Drop Languages with Reconstruction Modelscited by 14
- 2019DiaBLa: A Corpus of Bilingual Spontaneous Written Dialogues for Machine Translationcited by 12
- 2016Automatic Construction of Discourse Corpora for Dialogue Translationcited by 10
- 2018Neural Machine Translation of Text from Non-Native Speakerscited by 10
- 2019An Analysis of Source-Side Grammatical Errors in NMTcited by 6
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 1; 2024: 2.
8 papers.
- 2021Modeling Bilingual Conversational Characteristics for Neural Chat Translationcited by 18
- 2021Towards Making the Most of Dialogue Characteristics for Neural Chat Translationcited by 12
- 2022The Cross-lingual Conversation Summarization Challengecited by 8
- 2022Scheduled Multi-task Learning for Neural Chat Translationcited by 7
- 2024A Case Study on Context-Aware Neural Machine Translation with Multi-Task Learningcited by 4
- 2023A Multi-task Multi-stage Transitional Training Framework for Neural Chat Translationcited by 3
- 2021Secoco: Self-Correcting Encoding for Neural Machine Translationcited by 2
- 2024An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translationcited by 0
- 2024A Case Study on Context-Aware Neural Machine Translation with Multi-Task Learning3 Jul 2024
- 2024An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation13 May 2024
- 2023A Multi-task Multi-stage Transitional Training Framework for Neural Chat Translation27 Jan 2023
- 2022Scheduled Multi-task Learning for Neural Chat Translation8 May 2022
- 2022The Cross-lingual Conversation Summarization Challenge1 May 2022
- 2021Towards Making the Most of Dialogue Characteristics for Neural Chat Translation2 Sep 2021
- 2021Secoco: Self-Correcting Encoding for Neural Machine Translation27 Aug 2021
- 2021Modeling Bilingual Conversational Characteristics for Neural Chat Translation23 Jul 2021