mlsanityData to 7 Oct 2026

Thinking Slow about Latency Evaluation for Simultaneous Machine Translation

arXiv 1906.00048 ↗First posted 31 May 2019cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

Simultaneous machine translation attempts to translate a source sentence before it is finished being spoken, with applications to translation of spoken language for live streaming and conversation. Since simultaneous systems trade quality to reduce latency, having an effective and interpretable latency metric is crucial. We introduce a variant of the recently proposed Average Lagging (AL) metric, which we call Differentiable Average Lagging (DAL). It distinguishes itself by being differentiable and internally consistent to its underlying mathematical model.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 May 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 7; 2022: 7; 2023: 3; 2024: 5; 2025: 2; 2026: 3.

28 papers.

Sort:

By area:

  1. 2022Over-Generation Cannot Be Rewarded: Length-Adaptive Average Lagging for Simultaneous Speech Translationcited by 56
  2. 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
  3. 2022Attention as a Guide for Simultaneous Speech Translationcited by 32
  4. 2021Learning When to Translate for Streaming Speechcited by 30
  5. 2022CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022cited by 30
  6. 2022Does Simultaneous Speech Translation need Simultaneous Models?cited by 22
  7. 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
  8. 2022Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translationcited by 14
  9. 2021Stream-level Latency Evaluation for Simultaneous Machine Translationcited by 12
  10. 2020Learning Coupled Policies for Simultaneous Machine Translation using Imitation Learningcited by 10
  11. 2022From Simultaneous to Streaming Machine Translation by Leveraging Streaming Historycited by 9
  12. 2023End-to-End Speech-to-Text Translation: A Surveycited by 9
16 more
  1. 2021Towards the evaluation of automatic simultaneous speech translation from a communicative perspectivecited by 8
  2. 2021Decision Attentive Regularization to Improve Simultaneous Speech Translation Systemscited by 6
  3. 2022Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translationcited by 6
  4. 2023Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inferencecited by 6
  5. 2024Recent Advances in End-to-End Simultaneous Speech Translationcited by 5
  6. 2021Impact of Encoding and Segmentation Strategies on End-to-End Simultaneous Speech Translationcited by 4
  7. 2025Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translationcited by 4
  8. 2023Long-form Simultaneous Speech Translation: Thesis Proposalcited by 3
  9. 2021Visualization: the missing factor in Simultaneous Speech Translationcited by 2
  10. 2021A Discussion on Building Practical NLP Leaderboards: The Case of Machine Translationcited by 1
  11. 2024NAIST Simultaneous Speech Translation System for IWSLT 2024cited by 1
  12. 2025MFLA: Monotonic Finite Look-ahead Attention for Streaming Speech Recognitioncited by 1
  13. 2024CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translationcited by 0
  14. 2026TRADE: Transducer-Augmented Decoder for Speech LLMcited by 0
  15. 2026All In Good Time: Causality-Aware Framework for LLM-Based Simultaneous Speech-to-Speech Translationcited by 0
  16. 2026Simultaneous Translation between Sign Languagescited by 0