mlsanityData to 7 Oct 2026

textitVersteasch du mi? Computational and Socio-Linguistic Perspectives on GenAI, LLMs, and Non-Standard Language

arXiv 2603.28213 ↗First posted 30 Mar 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The design of Large Language Models (LLMs) and generative artificial intelligence (GenAI) has been shown to be "unfair" to less-spoken languages (Petrov et al., 2023) and to deepen the digital language divide (Bella et al., 2023). Critical sociolinguistic work has also argued that these technologies are not only made possible by prior sociohistorical processes of linguistic standardisation, often grounded in European nationalist and colonial projects (Migge and Schneider, 2025), but also exacerbate epistemologies of language as "monolithic, monolingual, syntactically standardized systems of meaning" (Schneider, 2024, p. 5). In our paper, we draw on earlier work on the intersections of technology and language policy (Kelly-Holmes, 2019) and bring our respective expertise in critical sociolinguistics and computational linguistics to bear on an interrogation of these arguments. We take two different complexes of non-standard linguistic varieties in our respective repertoires-South Tyrolean dialects, which are widely used in informal communication in South Tyrol, Italy (Alber et al., 2024), as well as varieties of Kurdish-as starting points to an interdisciplinary exploration of the intersections between GenAI and linguistic variation and standardisation. We discuss both how LLMs can be made to deal with non-standard language from a technical perspective, and whether, when or how this can contribute to "democratic and decolonial digital and machine learning strategies" (Migge and Schneider, 2025, p. 12), which has direct policy implications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 108 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

38 of 108 references.

References · 38

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2020Longformer: The Long-Document Transformercited by 3,362
  5. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  6. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  7. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  8. 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
  9. 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 207
  10. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
  11. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 180
  12. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 149
26 more
  1. 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluationcited by 73
  2. 2024DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languagescited by 49
  3. 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
  4. 2025The Bitter Lesson Learned from 2,000+ Multilingual Benchmarkscited by 31
  5. 2024Towards Multilingual LLM Evaluation for European Languagescited by 29
  6. 2022Not always about you: Prioritizing community needs when developing endangered language technologycited by 21
  7. 2024What Do Dialect Speakers Want? A Survey of Attitudes Towards Language Technology for German Dialectscited by 20
  8. 2021Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noisecited by 19
  9. 2023Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languagescited by 19
  10. 2023A Survey of Corpora for Germanic Low-Resource Languages and Dialectscited by 16
  11. 2025Large Language Models Discriminate Against Speakers of German Dialectscited by 13
  12. 2024Dialectal Toxicity Detection: Evaluating LLM-as-a-Judge Consistency Across Language Varietiescited by 10
  13. 2025Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Taskscited by 9
  14. 2024Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Datacited by 8
  15. 2024Cross-Dialect Information Retrieval: Information Access in Low-Resource and High-Variance Languagescited by 8
  16. 2023Towards Bridging the Digital Language Dividecited by 7
  17. 2024MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebankcited by 7
  18. 2024Don't Touch My Diacriticscited by 7
  19. 2025A Multi-Dialectal Dataset for German Dialect ASR and Dialect-to-Standard Speech Translationcited by 7
  20. 2021NorDial: A Preliminary Corpus of Written Norwegian Dialect Usecited by 5
  21. 2025Voxlect: A Speech Foundation Model Benchmark for Modeling Dialects and Regional Languages Around the Globecited by 5
  22. 2025IRLBench: A Multi-modal, Culturally Grounded, Parallel Irish-English Benchmark for Open-Ended LLM Reasoning Evaluationcited by 4
  23. 2023Script Normalization for Unconventional Writing of Under-Resourced Languages in Bilingual Communitiescited by 2
  24. 2025Steering LLMs toward Korean Local Speech: Iterative Refinement Framework for Faithful Dialect Translationcited by 1
  25. 2026Information Asymmetry across Language Varieties: A Case Study on Cantonese-Mandarin and Bavarian-German QAcited by 1
  26. 2026Indirect Question Answering in English, German and Bavarian: A Challenging Task for High- and Low-Resource Languages Alikecited by 1

Built on by

Not cited yet.