mlsanityData to 14 Oct 2026

Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategies

arXiv 2509.21801 ↗First posted 26 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Simultaneous Machine Translation (SiMT) requires high-quality translations under strict real-time constraints, which traditional encoder-decoder policies with only READ/WRITE actions cannot fully address. We extend the action space of SiMT with four adaptive actions: SENTENCE_CUT, DROP, PARTIAL_SUMMARIZATION and PRONOMINALIZATION, which enable real-time restructuring, omission, and simplification while preserving semantic fidelity. We implement these actions in a decoder-only large language model (LLM) framework and construct training references through action-aware prompting. To evaluate both quality and latency, we further develop a latency-aware TTS pipeline that maps textual outputs to speech with realistic timing. Experiments on the ACL60/60 English-Chinese and English-German benchmarks show that our framework consistently improves semantic metrics (e.g., COMET-KIWI) and achieves lower delay (measured by Average Lagging) compared to reference translations and salami-based baselines. Notably, combining DROP and SENTENCE_CUT yields the best overall balance between fluency and latency. These results demonstrate that enriching the action space of LLM-based SiMT provides a promising direction for bridging the gap between human and machine interpretation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 57 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

32 of 57 references.

References · 32

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  5. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  6. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  7. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
  8. 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
  9. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
  10. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
  11. 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
  12. 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 156
20 more
  1. 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 104
  2. 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
  3. 2020SimulEval: An Evaluation Toolkit for Simultaneous Translationcited by 94
  4. 2016Can neural machine translation do simultaneous translation?cited by 86
  5. 2017Online and Linear-Time Attention by Enforcing Monotonic Alignmentscited by 85
  6. 2016Edinburgh Neural Machine Translation Systems for WMT 16cited by 76
  7. 2022Over-Generation Cannot Be Rewarded: Length-Adaptive Average Lagging for Simultaneous Speech Translationcited by 57
  8. 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
  9. 2016Fast Domain Adaptation for Neural Machine Translationcited by 28
  10. 2018Revisiting Character-Based Neural Machine Translation with Capacity and Compressioncited by 28
  11. 2023End-to-End Simultaneous Speech Translation with Differentiable Segmentationcited by 22
  12. 2022Average Token Delay: A Latency Metric for Simultaneous Translationcited by 15
  13. 2024SiLLM: Large Language Models for Simultaneous Machine Translationcited by 13
  14. 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
  15. 2023Simultaneous Machine Translation with Large Language Modelscited by 9
  16. 2021It is Not as Good as You Think! Evaluating Simultaneous Machine Translation on Interpretation Datacited by 7
  17. 2025Adaptive Few-shot Prompting for Machine Translation with Pre-trained Language Modelscited by 6
  18. 2023BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluationcited by 5
  19. 2023Decomposed Prompting for Machine Translation Between Related Languages using Large Language Modelscited by 3
  20. 2024Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapterscited by 2

Built on by

Not cited yet.