PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation
Not on the map. Why?
Abstract (arXiv)
Simultaneous Machine Translation (SiMT) requires target tokens to be generated in real-time as streaming source tokens are consumed. Traditional approaches to SiMT typically require sophisticated architectures and extensive parameter configurations for training adaptive read/write policies, which in turn demand considerable computational power and memory. We propose PsFuture, the first zero-shot adaptive read/write policy for SiMT, enabling the translation model to independently determine read/write actions without the necessity for additional training. Furthermore, we introduce a novel training strategy, Prefix-to-Full (P2F), specifically tailored to adjust offline translation models for SiMT applications, exploiting the advantages of the bidirectional attention mechanism inherent in offline models. Experiments across multiple benchmarks demonstrate that our zero-shot policy attains performance on par with strong baselines and the P2F method can further enhance performance, achieving an outstanding trade-off between translation quality and latency.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 5 Oct 2024.
Builds on
24 of 31 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 103
- 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
- 2019Monotonic Multihead Attentioncited by 91
- 2020Efficient Wait-k Models for Simultaneous Machine Translationcited by 59
- 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 51
- 2020Simultaneous Translation Policies: From Fixed to Adaptivecited by 42
- 2022Information-Transport-based Policy for Simultaneous Translationcited by 40
- 2019Simpler and Faster Learning of Adaptive Policies for Simultaneous Translationcited by 36
12 more
- 2020Future-Guided Incremental Transformer for Simultaneous Translationcited by 30
- 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 24
- 2022Does Simultaneous Speech Translation need Simultaneous Models?cited by 22
- 2020Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderingscited by 20
- 2021BSTC: A Large-Scale Chinese-English Speech Translation Datasetcited by 16
- 2022Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Frameworkcited by 16
- 2022Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translationcited by 16
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
- 2023Non-autoregressive Streaming Transformer for Simultaneous Translationcited by 12
- 2023Simultaneous Machine Translation with Tailored Referencecited by 9
- 2023Adaptive Policy with Wait-k Model for Simultaneous Translationcited by 8
- 2023Enhanced Simultaneous Machine Translation with Word-level Policiescited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.