mlsanityData to 7 Oct 2026

The Generator-Eraser Paradox: Community Guidelines for Responsible LLM-Assisted Dialect Resource Creation

arXiv 2606.06004 ↗First posted 4 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Dialect resources occupy a unique position at the intersection of scientific description, cultural preservation, and computational infrastructure. Large language models offer powerful capabilities for accelerating dialect resource development through retrieval-grounded drafting, corpus navigation, metadata enrichment, and annotation workflow support. However, the same systems pose substantial risks: they can contribute to dialect erasure by privileging prestige varieties, homogenizing orthography, and enabling synthetic feedback loops that reduce linguistic diversity over time. These risks are particularly acute for language varieties characterized by diglossia, limited written standardization, or marginalized speaker communities. This paper makes three contributions. First, we integrate insights from variationist sociolinguistics and corpus linguistics to formalize the generator-eraser paradox as a theoretical framework for understanding the dual nature of LLM-assisted dialect work. Second, we derive 12 community guidelines that operationalize this framework into implementable design requirements for dialect resource creation and documentation. Third, we provide an in-depth case study of Arabic dialects, including a structured comparison of widely used resources, to demonstrate how these guidelines address language-specific challenges including diglossia, orthographic variability, and community governance. The contribution is conceptual and operational rather than experimental, with the goal of enabling dialect communities and resource builders across languages to adopt LLMs without sacrificing authenticity, variation, or sovereignty.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 45 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

11 of 45 references.

References · 11

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2018Datasheets for Datasetscited by 1,371
  3. 2018Model Cards for Model Reportingcited by 1,068
  4. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  5. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  6. 2016Demographic Dialectal Variation in Social Media: A Case Study of African-American Englishcited by 194
  7. 2020It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbationscited by 64
  8. 2021NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Taskcited by 32
  9. 2018Arap-Tweet: A Large Multi-Dialect Twitter Corpus for Gender, Age and Language Variety Identificationcited by 23
  10. 2016A Large Scale Corpus of Gulf Arabiccited by 17
  11. 2017Critical Survey of the Freely Available Arabic Corporacited by 7

Built on by

Not cited yet.