mlsanityData to 14 Oct 2026

SloPal: A 60-Million-Word Slovak Parliamentary Corpus with Aligned Speech and Fine-Tuned ASR Models

arXiv 2509.19270 ↗First posted 23 Sep 2025cs.CL cs.AI cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Slovak remains a low-resource language for automatic speech recognition (ASR), with fewer than 100 hours of publicly available training data. We present SloPal, a comprehensive Slovak parliamentary corpus comprising 330,000 speaker-segmented transcripts (66 million words, 220 million tokens) spanning 2001--2024, with rich metadata including speaker names, roles, and session information. From this collection, we derive SloPalSpeech, a 2,806-hour aligned speech dataset with segments up to 30 seconds, constructed using a language-agnostic anchor-based alignment pipeline and optimized for Whisper-based ASR training. Fine-tuning Whisper on SloPalSpeech reduces Word Error Rate (WER) by up to 70%, with the fine-tuned small model (244M parameters) approaching base large-v3 (1.5B parameters) performance at 6× fewer parameters. We publicly release the SloPal text corpus, SloPalSpeech aligned audio, and four fine-tuned Whisper models at https://huggingface.co/collections/NaiveNeuron/slopal, providing the most comprehensive open Slovak parliamentary language resource to date.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 27 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

9 of 27 references.

References · 9

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  4. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  5. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  6. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
  7. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
  8. 2024The ParlaSpeech Collection of Automatically Generated Speech and Text Datasets from Parliamentary Proceedingscited by 5
  9. 2025ParCzech4Speech: A New Speech Corpus Derived from Czech Parliamentary Datacited by 1

Built on by

Not cited yet.