mlsanityData to 14 Oct 2026

Automatic Lyric Transcription for Greek Songs: Scaling and Task Composition Effects in Whisper Adaptation

arXiv 2609.11302 ↗First posted 10 Sep 2026cs.CL cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Automatic Lyric Transcription (ALT) remains substantially more challenging than speech recognition due to melodic variability, rhythmic irregularity, and accompaniment interference. This is heightened in low-resource languages like Greek, where no prior benchmark for ALT exists. We present the first controlled study of Whisper adaptation for Greek ALT, investigating model scaling effects, task composition via multitask training in transcribe-translate ratios, and two-stage speech-to-singing adaptation. We also curate a segment-level aligned singing dataset based on the Greek Audio Dataset (GAD) using source separation and CTC forced alignment. Results show that scaling consistently improves performance, while multitask learning acts as a beneficial regularizer primarily for smaller-capacity models. The 2-stage adaptation in Whisper Large-v3 achieves a Word Error Rate (WER) of 27.2%, a significant improvement over zero-shot baselines, establishing the first Greek ALT benchmark.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

22 of 32 references.

References · 22

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  5. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  6. 2022Hybrid Transformers for Music Source Separationcited by 134
  7. 2017Sequence-to-Sequence Models Can Directly Translate Foreign Speechcited by 121
  8. 2020CTC-Segmentation of Large Corpora for German End-to-end Speech Recognitioncited by 76
  9. 2022SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Datacited by 49
  10. 2024LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASRcited by 36
  11. 2019DALI: a large Dataset of synchronized Audio, LyrIcs and notes, automatically created using teacher-student machine learning paradigmcited by 19
  12. 2019End-to-end Lyrics Alignment for Polyphonic Music Using an Audio-to-Character Recognition Modelcited by 15
10 more
  1. 2023LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPTcited by 15
  2. 2022A Dataset for Greek Traditional and Folk Music: Lyracited by 9
  3. 2022Sample-Efficient Unsupervised Domain Adaptation of Speech Recognition Systems A case study for Modern Greekcited by 7
  4. 2024Multistage Fine-tuning Strategies for Automatic Speech Recognition in Low-resource Languagescited by 6
  5. 2021End-to-end lyrics Recognition with Voice to Singing Style Transfercited by 5
  6. 2022MM-ALT: A Multimodal Automatic Lyric Transcription Systemcited by 4
  7. 2024The Greek podcast corpus: Competitive speech models for low-resourced languages with weakly supervised datacited by 4
  8. 2024More than words: Advancements and challenges in speech recognition for singingcited by 1
  9. 2025MSDA: Combining Pseudo-labeling and Self-Supervision for Unsupervised Domain Adaptation in ASRcited by 1
  10. 2025Enhancing Lyrics Transcription on Music Mixtures with Consistency Losscited by 1

Built on by

Not cited yet.