A Pocket Offline Model for Simultaneous Speech Translation as CUNI Submission to IWSLT 2026
Not on the map. Why?
Abstract (arXiv)
We implement simultaneous translation capability with the offline direct speech-to-text translation model Canary, using the state-of-the-art policy AlignAtt, and submit it to IWSLT 2026 Simultaneous Speech Translation Shared task for Czech to English and English to German and Italian. The strengths of our system are: (1) high translation quality, outperforming similarly sized baselines both in low- and high-latency regimes in computationally unaware simulations; (2) low computational requirements, as the model has only 1B parameters; (3) multilinguality -- support of 25 source and 25 target languages.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
16 of 26 references.
References · 16
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
- 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 104
- 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 60
- 2018Low-Latency Neural Speech Translationcited by 37
- 2023AlignAtt: Using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translationcited by 35
- 2022Does Simultaneous Speech Translation need Simultaneous Models?cited by 22
- 2024StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selectioncited by 19
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
- 2025MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talkscited by 14
- 2025Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025cited by 8
- 2022Simultaneous Translation for Unsegmented Input: A Sliding Window Approachcited by 6
4 more
- 2025Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translationcited by 4
- 2025Simulstream: Open-Source Toolkit for Evaluation and Demonstration of Streaming Speech-to-Text Translation Systemscited by 4
- 2026Pushing the Limits of On-Device Streaming ASR: A Compact, High-Accuracy English Model for Low-Latency Inferencecited by 2
- 2026Streaming Translation and Transcription Through Speech-to-Text Causal Alignmentcited by 1
Built on by
Not cited yet.