Standard-to-Dialect Transfer Trends Differ across Text and Speech: A Case Study on Intent and Topic Classification in German Dialects
Not on the map. Why?
Abstract (arXiv)
Research on cross-dialectal transfer from a standard to a non-standard dialect variety has typically focused on text data. However, dialects are primarily spoken, and non-standard spellings cause issues in text processing. We compare standard-to-dialect transfer in three settings: text models, speech models, and cascaded systems where speech first gets automatically transcribed and then further processed by a text model. We focus on German dialects in the context of written and spoken intent classification -- releasing the first dialectal audio intent classification dataset -- with supporting experiments on topic classification. The speech-only setup provides the best results on the dialect data while the text-only setup works best on the standard data. While the cascaded systems lag behind the text-only models for German, they perform relatively well on the dialectal data if the transcription system generates normalized, standard-like output.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 52 of its 75 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
52 of 75 references.
References · 52
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2023Scaling Speech Technology to 1,000+ Languagescited by 411
- 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 377
- 2020SLURP: A Spoken Language Understanding Resource Packagecited by 198
- 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
- 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 125
- 2023SONAR: Sentence-Level Multimodal and Language-Agnostic Representationscited by 108
38 more
- 2018Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehensioncited by 74
- 2024Self-Supervised Speech Representations are More Phonetic than Semanticcited by 71
- 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 66
- 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
- 2023AfroBench: How Good are Large Language Models on African Languages?cited by 43
- 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
- 2021SD-QA: Spoken Dialectal Question Answering for the Real Worldcited by 38
- 2023The Edinburgh International Accents of English Corpus: Towards the Democratization of English ASRcited by 36
- 2021Multilingual and Cross-Lingual Intent Detection from Spoken Datacited by 35
- 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 34
- 2021SwissDial: Parallel Multidialectal Corpus of Spoken Swiss Germancited by 26
- 2024What Do Dialect Speakers Want? A Survey of Attitudes Towards Language Technology for German Dialectscited by 21
- 2024Speech-MASSIVE: A Multilingual Speech Dataset for SLU and Beyondcited by 20
- 2023Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languagescited by 19
- 2023Putting Natural in Natural Language Processingcited by 17
- 2021Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systemscited by 15
- 2023Findings of the VarDial Evaluation Campaign 2023cited by 14
- 2024AraFinNLP 2024: The First Arabic Financial NLP Shared Taskcited by 12
- 2024Voices Unheard: NLP Resources and Models for Yor`ub'a Regional Dialectscited by 11
- 2023ITALIC: An Italian Intent Classification Datasetcited by 10
- 2024Evaluating Pixel Language Models on Non-Standardized Languagescited by 10
- 2023Fine-Tuning BERT with Character-Level Noise for Zero-Shot Transfer to Dialects and Closely-Related Languagescited by 9
- 2023UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructionscited by 9
- 2025Generative or Discriminative? Revisiting Text Classification in the Era of Transformerscited by 9
- 2025OpusLM: A Family of Open Unified Speech Language Modelscited by 9
- 2025Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Taskscited by 9
- 2023Spaiche: Extending State-of-the-Art ASR Models to Swiss German Dialectscited by 8
- 2024Does Whisper understand Swiss German? An automatic, qualitative, and human evaluationcited by 8
- 2025Adapting Whisper for Regional Dialects: Enhancing Public Services for Vulnerable Populations in the United Kingdomcited by 7
- 2025A Multi-Dialectal Dataset for German Dialect ASR and Dialect-to-Standard Speech Translationcited by 7
- 2024We're Calling an Intervention: Exploring Fundamental Hurdles in Adapting Language Models to Nonstandard Textcited by 6
- 2024SpeechTaxi: On Multilingual Semantic Speech Classificationcited by 6
- 2024Dialectal Coverage And Generalization in Arabic Speech Recognitioncited by 6
- 2023Towards dialect-inclusive recognition in a low-resource language: are balanced corpora the answer?cited by 5
- 2022Skit-S2I: An Indian Accented Speech to Intent datasetcited by 4
- 2023The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translationcited by 4
- 2024Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varietiescited by 4
- 2025Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Studycited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Indirect Question Answering in English, German and Bavarian: A Challenging Task for High- and Low-Resource Languages Alikecited by 1
- 2026Subtitle-Aligned Fine-Tuning of Whisper for Swiss German ASR: Benchmark Contamination, Convention Mismatch, and an Honest Baseline at 25.6% WER (13.8% cWER)cited by 1
- 2026Subtitle-Aligned Fine-Tuning of Whisper for Swiss German ASR: Benchmark Contamination, Convention Mismatch, and an Honest Baseline at 25.6% WER (13.8% cWER)29 May 2026
- 2026Indirect Question Answering in English, German and Bavarian: A Challenging Task for High- and Low-Resource Languages Alike16 Mar 2026