mlsanityData to 14 Oct 2026

CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022

arXiv 2204.06028 ↗First posted 12 Apr 2022cs.CLcited by 30

Not on the map. Why?

Abstract (arXiv)

In this paper, we describe our submission to the Simultaneous Speech Translation at IWSLT 2022. We explore strategies to utilize an offline model in a simultaneous setting without the need to modify the original model. In our experiments, we show that our onlinization algorithm is almost on par with the offline setting while being 3× faster than offline in terms of latency on the test set. We also show that the onlinized offline model outperforms the best IWSLT2021 simultaneous system in medium and high latency regimes and is almost on par in the low latency regime. We make our system publicly available.

Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 16 of its 34 references that are in the map. First posted on arXiv 12 Apr 2022.

Builds on

16 of 34 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  5. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  6. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  7. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
  8. 2020SimulEval: An Evaluation Toolkit for Simultaneous Translationcited by 94
  9. 2016Can neural machine translation do simultaneous translation?cited by 86
  10. 2016Toward Multilingual Neural Machine Translation with Universal Encoder and Decodercited by 76
  11. 2020Low-Latency Sequence-to-Sequence Speech Recognition and Translation by Partial Hypothesis Selectioncited by 49
  12. 2019Thinking Slow about Latency Evaluation for Simultaneous Machine Translationcited by 28
4 more
  1. 2020Relative Positional Encoding for Speech Recognition and Direct Translationcited by 23
  2. 2020Super-Human Performance in Online Low-latency Recognition of Conversational Speechcited by 20
  3. 2021The USTC-NELSLIP Systems for Simultaneous Speech Translation Task at IWSLT 2021cited by 13
  4. 2020ON-TRAC Consortium for End-to-End and Simultaneous Speech Translation Challenge Tasks at IWSLT 2020cited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 12; 2024: 9; 2025: 2; 2026: 5.

30 papers.

Sort:

  1. 2023AlignAtt: Using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translationcited by 35
  2. 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
  3. 2022Attention as a Guide for Simultaneous Speech Translationcited by 32
  4. 2023Turning Whisper into Real-Time Transcription Systemcited by 24
  5. 2024StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selectioncited by 19
  6. 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
  7. 2023ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkitcited by 10
  8. 2023End-to-End Evaluation for Low-Latency Simultaneous Speech Translationcited by 10
  9. 2022MT Metrics Correlate with Human Ratings of Simultaneous Speech Translationcited by 9
  10. 2023Simultaneous Machine Translation with Large Language Modelscited by 9
  11. 2023Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoffcited by 8
  12. 2025Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025cited by 8
18 more
  1. 2023KIT's Multilingual Speech Translation System for IWSLT 2023cited by 7
  2. 2024Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detectioncited by 7
  3. 2023Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Datacited by 6
  4. 2023Long-Form End-to-End Speech Translation via Latent Alignment Segmentationcited by 6
  5. 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023cited by 6
  6. 2024Conversational SimulMT: Efficient Simultaneous Translation with Large Language Modelscited by 4
  7. 2025Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translationcited by 4
  8. 2023Long-form Simultaneous Speech Translation: Thesis Proposalcited by 3
  9. 2023Robustness of Multi-Source MT to Transcription Errorscited by 2
  10. 2024R-BI: Regularized Batched Inputs enhance Incremental Decoding Framework for Low-Latency Simultaneous Speech Translationcited by 1
  11. 2024SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translationcited by 1
  12. 2024NAIST Simultaneous Speech Translation System for IWSLT 2024cited by 1
  13. 2024Titanic Calling: Low Bandwidth Video Conference from the Titanic Wreckcited by 1
  14. 2026Streaming Translation and Transcription Through Speech-to-Text Causal Alignmentcited by 1
  15. 2026SimulU: Training-free Policy for Long-form Simultaneous Speech-to-Speech Translationcited by 0
  16. 2026AlignAtt4LLM: Fast AlignAtt for Decoder-Only LLMs at IWSLT 2026 Simultaneous Speech Translation Taskcited by 0
  17. 2026MLLP-VRAIN UPV system for the IWSLT 2026 Simultaneous Speech Translation taskcited by 0
  18. 2026Do LLMs Need Architectural Changes for Simultaneous Speech Translation? A Prefix-to-Prefix Data Driven Approachcited by 0