Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategies
Not on the map. Why?
Abstract (arXiv)
Simultaneous Machine Translation (SiMT) requires high-quality translations under strict real-time constraints, which traditional policies with only READ/WRITE actions cannot fully address. We extend the action space of SiMT with four adaptive actions: Sentence_Cut, Drop, Partial_Summarization and Pronominalization, which enable real-time restructuring, omission, and simplification while preserving semantic fidelity. We adapt these actions in a large language model (LLM) framework and construct training references through action-aware prompting. To evaluate both quality and word-level monotonicity, we further develop a latency-aware TTS pipeline that maps textual outputs to speech with realistic timing. Experiments on the ACL60/60 English-Chinese, English-German and English-Japanese benchmarks show that our framework consistently improves semantic metrics and achieves lower delay compared to reference translations and salami-based baselines. Notably, combining Drop and Sentence_Cut leads to consistent improvements in the balance between fluency and latency. These results demonstrate that enriching the action space of LLM-based SiMT provides a promising direction for bridging the gap between human and machine interpretation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 57 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
32 of 57 references.
References · 32
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 205
- 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 155
20 more
- 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 103
- 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
- 2020SimulEval: An Evaluation Toolkit for Simultaneous Translationcited by 94
- 2016Can neural machine translation do simultaneous translation?cited by 85
- 2017Online and Linear-Time Attention by Enforcing Monotonic Alignmentscited by 85
- 2016Edinburgh Neural Machine Translation Systems for WMT 16cited by 76
- 2022Over-Generation Cannot Be Rewarded: Length-Adaptive Average Lagging for Simultaneous Speech Translationcited by 56
- 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
- 2016Fast Domain Adaptation for Neural Machine Translationcited by 28
- 2018Revisiting Character-Based Neural Machine Translation with Capacity and Compressioncited by 28
- 2023End-to-End Simultaneous Speech Translation with Differentiable Segmentationcited by 22
- 2022Average Token Delay: A Latency Metric for Simultaneous Translationcited by 15
- 2024SiLLM: Large Language Models for Simultaneous Machine Translationcited by 13
- 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
- 2023Simultaneous Machine Translation with Large Language Modelscited by 9
- 2021It is Not as Good as You Think! Evaluating Simultaneous Machine Translation on Interpretation Datacited by 7
- 2025Adaptive Few-shot Prompting for Machine Translation with Pre-trained Language Modelscited by 6
- 2023BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluationcited by 5
- 2023Decomposed Prompting for Machine Translation Between Related Languages using Large Language Modelscited by 3
- 2024Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapterscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.