mlsanityData to 7 Oct 2026

CAM~OES: A Comprehensive Automatic Speech Recognition Benchmark for European Portuguese

arXiv 2508.19721 ↗First posted 27 Aug 2025cs.CL eess.AScited by 2

Not on the map. Why?

Abstract (arXiv)

Existing resources for Automatic Speech Recognition in Portuguese are mostly focused on Brazilian Portuguese, leaving European Portuguese (EP) and other varieties under-explored. To bridge this gap, we introduce CAM~OES, the first open framework for EP and other Portuguese varieties. It consists of (1) a comprehensive evaluation benchmark, including 46h of EP test data spanning multiple domains; and (2) a collection of state-of-the-art models. For the latter, we consider multiple foundation models, evaluating their zero-shot and fine-tuned performances, as well as E-Branchformer models trained from scratch. A curated set of 425h of EP was used for both fine-tuning and training. Our results show comparable performance for EP between fine-tuned foundation models and the E-Branchformer. Furthermore, the best-performing models achieve relative improvements above 35% WER, compared to the strongest zero-shot foundation model, establishing a new state-of-the-art for EP and other varieties.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 82 references that are in the map. First posted on arXiv 27 Aug 2025.

Builds on

36 of 82 references.

References · 36

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  5. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  6. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  7. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  8. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  9. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  10. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  11. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  12. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
24 more
  1. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  2. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  3. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 340
  4. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
  5. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  6. 2019A Comparative Study on Transformer vs RNN in Speech Applicationscited by 210
  7. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 190
  8. 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 120
  9. 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
  10. 2021SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Networkcited by 83
  11. 2023ML-SUPERB: Multilingual Speech Universal PERformance Benchmarkcited by 70
  12. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
  13. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  14. 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
  15. 2023MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translationcited by 39
  16. 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
  17. 2025Investigation of Whisper ASR Hallucinations Induced by Non-Speech Audiocited by 31
  18. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  19. 2024WER We Stand: Benchmarking Urdu ASR Modelscited by 8
  20. 2021Brazilian Portuguese Speech Recognition Using Wav2vec 2.0cited by 6
  21. 2022Cem Mil Podcasts: A Spoken Portuguese Document Corpus For Multi-modal, Multi-lingual and Multi-Dialect Information Access Researchcited by 6
  22. 2024uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimescited by 3
  23. 2024A Large Dataset of Spontaneous Speech with the Accent Spoken in S~ao Paulo for Automatic Speech Recognition Evaluationcited by 3
  24. 2025Benchmarking Rotary Position Embeddings for Automatic Speech Recognitioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026Exploring the potential and limitations of Model Merging for Multi-Domain Adaptation in ASRcited by 0
  2. 2026FalAR: A Large-scale Speaker-Annotated European Portuguese Speech Corpus of Parliamentary Sessionscited by 0