Data to 7 Oct 2026

SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translation

arXiv 2011.02048 ↗First posted 3 Nov 2020cs.CLcited by 80

Not on the map. Why?

Abstract (arXiv)

Simultaneous text translation and end-to-end speech translation have recently made great progress but little work has combined these tasks together. We investigate how to adapt simultaneous text translation methods such as wait-k and monotonic multihead attention to end-to-end simultaneous speech translation by introducing a pre-decision module. A detailed analysis is provided on the latency-quality trade-offs of combining fixed and flexible pre-decision with fixed and flexible policies. We also design a novel computation-aware latency metric, adapted from Average Lagging.

Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 11; 2022: 11; 2023: 16; 2024: 23; 2025: 10; 2026: 9.

80 papers.

Sort:

By area:

2022Over-Generation Cannot Be Rewarded: Length-Adaptive Average Lagging for Simultaneous Speech Translationcited by 56
2022Information-Transport-based Policy for Simultaneous Translationcited by 40
2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 39
2023AlignAtt: Using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translationcited by 35
2022Attention as a Guide for Simultaneous Speech Translationcited by 32
2021Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASRcited by 31
2021Learning When to Translate for Streaming Speechcited by 30
2021SimulSLT: End-to-End Simultaneous Sign Language Translationcited by 26
2024Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?cited by 23
2022Does Simultaneous Speech Translation need Simultaneous Models?cited by 22
2023End-to-End Simultaneous Speech Translation with Differentiable Segmentationcited by 22
2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learningcited by 20

38 more

2024StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selectioncited by 19
2024BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5cited by 18
2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
2022Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translationcited by 14
2022Efficient yet Competitive Speech Translation: FBK@IWSLT2022cited by 14
2024Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agentcited by 14
2025Efficient and Adaptive Simultaneous Speech Translation with Fully Unidirectional Architecturecited by 12
2022Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translationcited by 11
2024Simultaneous Masking, Not Prompting Optimization: A Paradigm Shift in Fine-tuning LLMs for Simultaneous Translationcited by 11
2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
2023ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkitcited by 10
2024A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Speech Translationcited by 10
2021Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attentioncited by 9
2021Simultaneous Speech Translation for Live Subtitling: from Delay to Displaycited by 8
2023Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoffcited by 8
2023Efficient Monotonic Multihead Attentioncited by 8
2025InfiniSST: Simultaneous Translation of Unbounded Speech with Large Language Modelcited by 8
2021SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memorycited by 7
2024FASST: Fast LLM-based Simultaneous Speech Translationcited by 7
2021Decision Attentive Regularization to Improve Simultaneous Speech Translation Systemscited by 6
2023Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inferencecited by 6
2023Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Datacited by 6
2023Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignmentscited by 6
2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023cited by 6
2023Unified Segment-to-Segment Framework for Simultaneous Sequence Generationcited by 6
2025StreamUni: Achieving Streaming Speech Translation with a Unified Large Speech-Language Modelcited by 6
2022Anticipation-Free Training for Simultaneous Machine Translationcited by 5
2022Joint Speech Translation and Named Entity Recognitioncited by 5
2024Recent Advances in End-to-End Simultaneous Speech Translationcited by 5
2024Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translationcited by 5
2022Align, Write, Re-order: Explainable End-to-End Speech Translation via Operation Sequence Generationcited by 4
2023LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translationcited by 4
2023Shiftable Context: Addressing Training-Inference Context Mismatch in Simultaneous Speech Translationcited by 4
2023Implicit Memory Transformer for Computationally Efficient Simultaneous Speech Translationcited by 4
2024Conversational SimulMT: Efficient Simultaneous Translation with Large Language Modelscited by 4
2024Overcoming Non-monotonicity in Transducer-based Streaming Generationcited by 4
2024Transducer-Llama: Integrating LLMs into Streamable Transducer-based Speech Recognitioncited by 4
2025Large Language Models Are Read/Write Policy-Makers for Simultaneous Generationcited by 4

50 most cited of 80 All 80 (JSON)