mlsanityData to 14 Oct 2026

Over-Generation Cannot Be Rewarded: Length-Adaptive Average Lagging for Simultaneous Speech Translation

arXiv 2206.05807 ↗First posted 12 Jun 2022cs.CLcited by 57

Not on the map. Why?

Abstract (arXiv)

Simultaneous speech translation (SimulST) systems aim at generating their output with the lowest possible latency, which is normally computed in terms of Average Lagging (AL). In this paper we highlight that, despite its widespread adoption, AL provides underestimated scores for systems that generate longer predictions compared to the corresponding references. We also show that this problem has practical relevance, as recent SimulST systems have indeed a tendency to over-generate. As a solution, we propose LAAL (Length-Adaptive Average Lagging), a modified version of the metric that takes into account the over-generation phenomenon and allows for unbiased evaluation of both under-/over-generating systems.

Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 12 Jun 2022.

Builds on

14 of 23 references.

References · 14

  1. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  2. 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
  3. 2018Exploring Architectures, Data and Units For Streaming End-to-End Speech Recognition with RNN-Transducercited by 96
  4. 2020SimulEval: An Evaluation Toolkit for Simultaneous Translationcited by 94
  5. 2016Can neural machine translation do simultaneous translation?cited by 86
  6. 2020SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translationcited by 81
  7. 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 40
  8. 2021Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASRcited by 31
  9. 2019Thinking Slow about Latency Evaluation for Simultaneous Machine Translationcited by 28
  10. 2022Does Simultaneous Speech Translation need Simultaneous Models?cited by 22
  11. 2022Efficient yet Competitive Speech Translation: FBK@IWSLT2022cited by 14
  12. 2021Simultaneous Speech Translation for Live Subtitling: from Delay to Displaycited by 8
2 more
  1. 2020Online Versus Offline NMT Quality: An In-depth Analysis on English-German and German-Englishcited by 6
  2. 2021Visualization: the missing factor in Simultaneous Speech Translationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 11; 2024: 21; 2025: 12; 2026: 10.

57 papers.

Sort:

By area:

  1. 2023AlignAtt: Using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translationcited by 35
  2. 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
  3. 2022Attention as a Guide for Simultaneous Speech Translationcited by 32
  4. 2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learningcited by 21
  5. 2023Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Taskscited by 20
  6. 2024StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selectioncited by 19
  7. 2024BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5cited by 19
  8. 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
  9. 2022Average Token Delay: A Latency Metric for Simultaneous Translationcited by 15
  10. 2025High-Fidelity Simultaneous Speech-To-Speech Translationcited by 15
  11. 2024Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agentcited by 14
  12. 2025Efficient and Adaptive Simultaneous Speech Translation with Fully Unidirectional Architecturecited by 12
38 more
  1. 2024Simultaneous Masking, Not Prompting Optimization: A Paradigm Shift in Fine-tuning LLMs for Simultaneous Translationcited by 11
  2. 2024A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Speech Translationcited by 10
  3. 2023Simultaneous Machine Translation with Large Language Modelscited by 9
  4. 2025Seed LiveInterpret 2.0: End-to-end Simultaneous Speech-to-speech Translation with Your Voicecited by 9
  5. 2023Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoffcited by 8
  6. 2025InfiniSST: Simultaneous Translation of Unbounded Speech with Large Language Modelcited by 8
  7. 2024FASST: Fast LLM-based Simultaneous Speech Translationcited by 7
  8. 2025SimulPL: Aligning Human Preferences in Simultaneous Machine Translationcited by 7
  9. 2026Simultaneous Speech-to-Speech Translation Without Aligned Datacited by 7
  10. 2023Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignmentscited by 6
  11. 2023Long-Form End-to-End Speech Translation via Latent Alignment Segmentationcited by 6
  12. 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023cited by 6
  13. 2023Simul-LLM: A Framework for Exploring High-Quality Simultaneous Translation with Large Language Modelscited by 6
  14. 2022Joint Speech Translation and Named Entity Recognitioncited by 5
  15. 2024Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translationcited by 5
  16. 2025LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offlinecited by 5
  17. 2023Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translationcited by 4
  18. 2024Overcoming Non-monotonicity in Transducer-based Streaming Generationcited by 4
  19. 2025Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translationcited by 4
  20. 2023Long-form Simultaneous Speech Translation: Thesis Proposalcited by 3
  21. 2024Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Paircited by 3
  22. 2024Navigating the Minefield of MT Beam Search in Cascaded Streaming Speech Translationcited by 3
  23. 2025SimulS2S-LLM: Unlocking Simultaneous Inference of Speech LLMs for Speech-to-Speech Translationcited by 3
  24. 2023Average Token Delay: A Duration-aware Latency Metric for Simultaneous Translationcited by 2
  25. 2024Assessing Latency in ASR Systems: A Methodological Perspective for Real-Time Usecited by 2
  26. 2025Chunk Based Speech Pre-training with High Resolution Finite Scalar Quantizationcited by 2
  27. 2024SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translationcited by 1
  28. 2024NAIST Simultaneous Speech Translation System for IWSLT 2024cited by 1
  29. 2024An Automatic Quality Metric for Evaluating Simultaneous Interpretationcited by 1
  30. 2024CMU's IWSLT 2024 Simultaneous Speech Translation Systemcited by 1
  31. 2024What does it take to get state of the art in simultaneous speech-to-speech translation?cited by 1
  32. 2024Anticipating Future with Large Language Model for Simultaneous Machine Translationcited by 1
  33. 2025REINA: Regularized Entropy Information-Based Loss for Efficient Simultaneous Speech Translationcited by 1
  34. 2026Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategiescited by 1
  35. 2026Hierarchical Policy Optimization for Simultaneous Translation of Unbounded Speechcited by 1
  36. 2024CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translationcited by 0
  37. 2025Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategiescited by 0
  38. 2025SimulSense: Sense-Driven Interpreting for Efficient Simultaneous Speech Translationcited by 0

50 most cited of 57 All 57 (JSON)