mlsanityData to 7 Oct 2026

Adaptive Policy with Wait-k Model for Simultaneous Translation

arXiv 2310.14853 ↗First posted 23 Oct 2023cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Simultaneous machine translation (SiMT) requires a robust read/write policy in conjunction with a high-quality translation model. Traditional methods rely on either a fixed wait-k policy coupled with a standalone wait-k translation model, or an adaptive policy jointly trained with the translation model. In this study, we propose a more flexible approach by decoupling the adaptive policy model from the translation model. Our motivation stems from the observation that a standalone multi-path wait-k model performs competitively with adaptive policies utilized in state-of-the-art SiMT approaches. Specifically, we introduce DaP, a divergence-based adaptive policy, that makes read/write decisions for any translation model based on the potential divergence in translation distributions resulting from future information. DaP extends a frozen wait-k model with lightweight parameters, and is both memory and computation efficient. Experimental results across various benchmarks demonstrate that our approach offers an improved trade-off between translation accuracy and latency, outperforming strong baselines.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 32 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

20 of 32 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  5. 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 103
  6. 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
  7. 2019Monotonic Multihead Attentioncited by 91
  8. 2020Efficient Wait-k Models for Simultaneous Machine Translationcited by 59
  9. 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 51
  10. 2020Simultaneous Translation Policies: From Fixed to Adaptivecited by 42
  11. 2022Information-Transport-based Policy for Simultaneous Translationcited by 40
  12. 2019Simpler and Faster Learning of Adaptive Policies for Simultaneous Translationcited by 36
8 more
  1. 2020Future-Guided Incremental Transformer for Simultaneous Translationcited by 30
  2. 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 24
  3. 2021BSTC: A Large-Scale Chinese-English Speech Translation Datasetcited by 16
  4. 2022Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translationcited by 16
  5. 2019Lattice Transformer for Speech Translationcited by 15
  6. 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
  7. 2023Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inferencecited by 6
  8. 2023Neural Machine Translation with Dynamic Graph Convolutional Decodercited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 1; 2026: 1.

8 papers.