mlsanityData to 7 Oct 2026

Spaiche: Extending State-of-the-Art ASR Models to Swiss German Dialects

arXiv 2304.11075 ↗First posted 20 Apr 2023cs.CL cs.LG cs.SDcited by 8

Not on the map. Why?

Abstract (arXiv)

Recent breakthroughs in NLP largely increased the presence of ASR systems in our daily lives. However, for many low-resource languages, ASR models still need to be improved due in part to the difficulty of acquiring pertinent data. This project aims to help advance research in ASR models for Swiss German dialects, by providing insights about the performance of state-of-the-art ASR models on recently published Swiss German speech datasets. We propose a novel loss that takes into account the semantic distance between the predicted and the ground-truth labels. We outperform current state-of-the-art results by fine-tuning OpenAI's Whisper model on Swiss-German datasets.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 20 Apr 2023.

Builds on

16 of 26 references.

References · 16

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  5. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  6. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  7. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  8. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  9. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  10. 2018Universal Sentence Encodercited by 485
  11. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  12. 2021Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understandingcited by 40
4 more
  1. 2021SwissDial: Parallel Multidialectal Corpus of Spoken Swiss Germancited by 25
  2. 2022SDS-200: A Swiss German Speech to Standard German Text Corpuscited by 22
  3. 2020Swiss Parliaments Corpus, an Automatically Aligned Swiss German Speech to Standard German Text Corpuscited by 16
  4. 2022Swiss German Speech to Text system evaluationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 1.

8 papers.

  1. 2024Fine-tuning Whisper on Low-Resource Languages for Real-World Applicationscited by 11
  2. 2024Does Whisper understand Swiss German? An automatic, qualitative, and human evaluationcited by 8
  3. 2025A Multi-Dialectal Dataset for German Dialect ASR and Dialect-to-Standard Speech Translationcited by 7
  4. 2025Whisper-LM: Improving ASR Models with Language Models for Low-Resource Languagescited by 4
  5. 2025Standard-to-Dialect Transfer Trends Differ across Text and Speech: A Case Study on Intent and Topic Classification in German Dialectscited by 2
  6. 2025Advancing STT for Low-Resource Real-World Speechcited by 1
  7. 2026Subtitle-Aligned Fine-Tuning of Whisper for Swiss German ASR: Benchmark Contamination, Convention Mismatch, and an Honest Baseline at 25.6% WER (13.8% cWER)cited by 1
  8. 2025SwissGPC v1.0 -- The Swiss German Podcasts Corpuscited by 0