mlsanityData to 14 Oct 2026

Granary: Speech Recognition and Translation Dataset in 25 European Languages

arXiv 2505.13404 ↗First posted 19 May 2025cs.CL eess.AScited by 22

Not on the map. Why?

Abstract (arXiv)

Multi-task and multilingual approaches benefit large models, yet speech processing for low-resource languages remains underexplored due to data scarcity. To address this, we present Granary, a large-scale collection of speech datasets for recognition and translation across 25 European languages. This is the first open-source effort at this scale for both transcription and translation. We enhance data quality using a pseudo-labeling pipeline with segmentation, two-pass inference, hallucination filtering, and punctuation restoration. We further generate translation pairs from pseudo-labeled transcriptions using EuroLLM, followed by a data filtration pipeline. Designed for efficiency, our pipeline processes vast amount of data within hours. We assess models trained on processed data by comparing their performance on previously curated datasets for both high- and low-resource languages. Our findings show that these models achieve similar performance using approx. 50% less data. Dataset will be made available at https://hf.co/datasets/nvidia/Granary

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

20 of 31 references.

References · 20

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2024Qwen2 Technical Reportcited by 2,120
  3. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  4. 2020Beyond English-Centric Multilingual Machine Translationcited by 561
  5. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 560
  6. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  7. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 467
  8. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
  9. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
  10. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
  11. 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 124
  12. 2024EuroLLM: Multilingual Language Models for Europecited by 106
8 more
  1. 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 89
  2. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 60
  3. 2021Lhotse: a speech data representation library for the modern deep learning ecosystemcited by 33
  4. 2023There's no Data Like Better Data: Using QE Metrics for MT Data Filteringcited by 19
  5. 2024MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languagescited by 14
  6. 2024Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Datacited by 10
  7. 2024Longer is (Not Necessarily) Stronger: Punctuated Long-Sequence Training for Enhanced Speech Recognition and Translationcited by 4
  8. 2024PyMarian: Fast Neural Machine Translation and Evaluation in Pythoncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 19.

22 papers.

Sort:

By area:

  1. 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 25
  2. 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Musiccited by 19
  3. 2025Discrete Diffusion for Generative Modeling of Text-Aligned Speech Tokenscited by 7
  4. 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 7
  5. 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoningcited by 6
  6. 2026X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloningcited by 4
  7. 2026Transcription Policy as a Latent Variable: Activating Controllable Verbatim ASR with Word-Level Timingcited by 3
  8. 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMscited by 1
  9. 2026Reducing the Offline-Streaming Gap for Unified ASR Transducer with Consistency Regularizationcited by 1
  10. 2026WorldSpeech: A Multilingual Speech Corpus from Around the Worldcited by 1
  11. 2026Enabling Streaming User Transcription in Full-Duplex Speech-to-Speech Modelscited by 1
  12. 2025Leveraging Multiple Speech Enhancers for Non-Intrusive Intelligibility Prediction for Hearing-Impaired Listenerscited by 0
10 more
  1. 2026Scalable Multilingual Multimodal Machine Translation with Speech-Text Fusioncited by 0
  2. 2026Identification and Anonymization of Named Entities in Unstructured Information Sources for Use in Social Engineering Detectioncited by 0
  3. 2026AfriVox-v2: A Domain-Verticalized Benchmark for In-the-Wild African Speech Recognitioncited by 0
  4. 2026SCRIBE: Diagnostic Evaluation and Rich Transcription Models for Indic ASRcited by 0
  5. 2026TRADE: Transducer-Augmented Decoder for Speech LLMcited by 0
  6. 2026Data Scale, Not Latency, Shapes Cross-Lingual Encoder Transfer in Streaming ASRcited by 0
  7. 2026ZONOS2 Technical Reportcited by 0
  8. 2026Comparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case Studycited by 0
  9. 2026How to Reduce Whisper Hallucinationcited by 0
  10. 2026CAFE: Confining Feature Distillation to Language-Routed Adapters for Compact Multilingual Automatic Speech Recognitioncited by 0