Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinement
Not on the map. Why?
Abstract (arXiv)
Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as-yet-unarrived words, when dealing with a language pair whose word orders significantly differ. This is unlike human simultaneous interpreters who produce largely monotonic translations at the expense of the grammaticality of a sentence being translated. In this paper, we thus propose an algorithm to reorder and refine the target side of a full sentence translation corpus, so that the words/phrases between the source and target sentences are aligned largely monotonically, using word alignment and non-autoregressive neural machine translation. We then train a widely used wait-k simultaneous translation model on this reordered-and-refined corpus. The proposed approach improves BLEU scores and resulting translations exhibit enhanced monotonicity with source sentences.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 18 Oct 2021.
Builds on
30 of 55 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2016Sequence-Level Knowledge Distillationcited by 801
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2018Adversarial Example Generation with Syntactically Controlled Paraphrase Networkscited by 286
- 2019Levenshtein Transformercited by 199
- 2018Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinementcited by 195
- 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 104
- 2020Fully Non-autoregressive Neural Machine Translation: Tricks of the Tradecited by 99
18 more
- 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
- 2019Monotonic Multihead Attentioncited by 93
- 2016Can neural machine translation do simultaneous translation?cited by 86
- 2018MTNT: A Testbed for Machine Translation of Noisy Textcited by 54
- 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 52
- 2020Simultaneous Translation Policies: From Fixed to Adaptivecited by 43
- 2019Simpler and Faster Learning of Adaptive Policies for Simultaneous Translationcited by 37
- 2020Re-translation versus Streaming for Simultaneous Translationcited by 31
- 2020Future-Guided Incremental Transformer for Simultaneous Translationcited by 30
- 2020End-to-End Neural Word Alignment Outperforms GIZA++cited by 28
- 2017Learning Paraphrastic Sentence Embeddings from Back-Translated Bitextcited by 27
- 2019Simultaneous Translation with Flexible Policy via Restricted Imitation Learningcited by 22
- 2020Simulated Multiple Reference Training Improves Low-Resource Machine Translationcited by 22
- 2020Simultaneous Machine Translation with Visual Contextcited by 17
- 2017JESC: Japanese-English Subtitle Corpuscited by 16
- 2020Opportunistic Decoding with Timely Correction for Simultaneous Translationcited by 8
- 2020Simultaneous paraphrasing and translation by fine-tuning Transformer modelscited by 1
- 2020Faster Re-translation Using Non-Autoregressive Model For Simultaneous Neural Machine Translationcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 0; 2026: 1.
4 papers.
- 2022Improving Simultaneous Machine Translation with Monolingual Datacited by 13
- 2024Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Paircited by 3
- 2024Word Order in English-Japanese Simultaneous Interpretation: Analyses and Evaluation using Chunk-wise Monotonic Translationcited by 1
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attentioncited by 0
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attention28 Sep 2026
- 2024Word Order in English-Japanese Simultaneous Interpretation: Analyses and Evaluation using Chunk-wise Monotonic Translation13 Jun 2024
- 2024Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair18 Apr 2024
- 2022Improving Simultaneous Machine Translation with Monolingual Data2 Dec 2022