Adaptive Policy with Wait-k Model for Simultaneous Translation
Not on the map. Why?
Abstract (arXiv)
Simultaneous machine translation (SiMT) requires a robust read/write policy in conjunction with a high-quality translation model. Traditional methods rely on either a fixed wait-k policy coupled with a standalone wait-k translation model, or an adaptive policy jointly trained with the translation model. In this study, we propose a more flexible approach by decoupling the adaptive policy model from the translation model. Our motivation stems from the observation that a standalone multi-path wait-k model performs competitively with adaptive policies utilized in state-of-the-art SiMT approaches. Specifically, we introduce DaP, a divergence-based adaptive policy, that makes read/write decisions for any translation model based on the potential divergence in translation distributions resulting from future information. DaP extends a frozen wait-k model with lightweight parameters, and is both memory and computation efficient. Experimental results across various benchmarks demonstrate that our approach offers an improved trade-off between translation accuracy and latency, outperforming strong baselines.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 32 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
20 of 32 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 103
- 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
- 2019Monotonic Multihead Attentioncited by 91
- 2020Efficient Wait-k Models for Simultaneous Machine Translationcited by 59
- 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 51
- 2020Simultaneous Translation Policies: From Fixed to Adaptivecited by 42
- 2022Information-Transport-based Policy for Simultaneous Translationcited by 40
- 2019Simpler and Faster Learning of Adaptive Policies for Simultaneous Translationcited by 36
8 more
- 2020Future-Guided Incremental Transformer for Simultaneous Translationcited by 30
- 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 24
- 2021BSTC: A Large-Scale Chinese-English Speech Translation Datasetcited by 16
- 2022Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translationcited by 16
- 2019Lattice Transformer for Speech Translationcited by 15
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
- 2023Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inferencecited by 6
- 2023Neural Machine Translation with Dynamic Graph Convolutional Decodercited by 2
Built on by
Citing papers per year: 2024: 6; 2025: 1; 2026: 1.
8 papers.
- 2024Anchor-based Large Language Modelscited by 12
- 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
- 2024Self-Modifying State Modeling for Simultaneous Machine Translationcited by 5
- 2025LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offlinecited by 5
- 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Modelscited by 2
- 2024Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapterscited by 2
- 2024PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translationcited by 2
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attentioncited by 0
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attention28 Sep 2026
- 2025LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline13 Apr 2025
- 2024PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation5 Oct 2024
- 2024Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapters18 Jul 2024
- 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models11 Jun 2024
- 2024Decoder-only Streaming Transformer for Simultaneous Translation6 Jun 2024
- 2024Self-Modifying State Modeling for Simultaneous Machine Translation4 Jun 2024
- 2024Anchor-based Large Language Models12 Feb 2024