mlsanityData to 14 Oct 2026

How Does "English (US)" Become the Default? Triangulating Structural Bias Towards American English Across the LLM Pipeline

arXiv 2604.04204 ↗First posted 5 Apr 2026cs.CL cs.AI cs.CYcited by 3

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly embedded in educational, professional, and public infrastructure, yet widely used platforms expose "English (US)" as a primary English setting despite the global diversity of English. We ask: How does "English (US)" become the default? We study this question as structural bias, examining how geopolitical histories of data curation, digital dominance, and linguistic standardization intersect with the LLM development pipeline. Using British English as a controlled reference, we construct a curated resource of 1,813 matched American English (AmE)--British English (BrE) variants and introduce DiAlign, a dynamic, training-free method for estimating regional alignment from distributional evidence. We triangulate the AmE preference across data exposure --> representation --> generation, jointly examining pretraining and post-training data, tokenizer behavior and provenance, model prediction cost, and generated language across developer countries, prompt conditions, domains and sources, linguistic categories, and registers. AmE is consistently favored across all six audited pretraining corpora and 21 post-training datasets, is generally represented more compactly by tokenizers, and receives lower prediction cost. It also remains the dominant generation default under neutral English prompting; British-English prompting shifts this preference toward BrE but does not consistently eliminate the AmE default. To our knowledge, this is the first rigorous pipeline-wide study of structural bias across major phases of LLM development. Our findings show that contemporary LLMs privilege AmE as the de facto norm, raising concerns about linguistic homogenization, epistemic injustice, and inequity in global AI deployment, while providing a rigorous basis for targeted component-level intervention.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 85 references that are in the map. First posted on arXiv 5 Apr 2026.

Builds on

49 of 85 references.

References · 49

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  3. 2023LIMA: Less Is More for Alignmentcited by 1,100
  4. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
  5. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  6. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  7. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
  8. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  9. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
  10. 2019ELI5: Long Form Question Answeringcited by 575
  11. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
  12. 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
37 more
  1. 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 406
  2. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  3. 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
  4. 2021Understanding Dataset Difficulty with V-Usable Informationcited by 291
  5. 2024PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preferencecited by 261
  6. 2024HelpSteer2: Open-source dataset for training top-performing reward modelscited by 236
  7. 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
  8. 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
  9. 2016Demographic Dialectal Variation in Social Media: A Case Study of African-American Englishcited by 196
  10. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 192
  11. 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 182
  12. 2024RedPajama: an Open Dataset for Training Large Language Modelscited by 182
  13. 2024QuRating: Selecting High-Quality Data for Training Language Modelscited by 157
  14. 2023What's In My Big Data?cited by 129
  15. 2023Large Language Models in Law: A Surveycited by 128
  16. 2023Tokenizer Choice For LLM Training: Negligible or Crucial?cited by 108
  17. 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curationcited by 76
  18. 2024Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discriminationcited by 56
  19. 2022Multi-VALUE: A Framework for Cross-Dialectal English NLPcited by 53
  20. 2024Open Problems in Technical AI Governancecited by 49
  21. 2022VALUE: Understanding Dialect Disparity in NLUcited by 47
  22. 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
  23. 2025Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Modelscited by 31
  24. 2023Data Portraits: Recording Foundation Model Training Datacited by 30
  25. 2020Learning to Recognize Dialect Featurescited by 29
  26. 2024Exploring Design Choices for Building Language-Specific LLMscited by 22
  27. 2025Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenizationcited by 20
  28. 2024Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarkscited by 17
  29. 2025Causal Estimation of Tokenisation Biascited by 16
  30. 2023Nichelle and Nancy: The Influence of Demographic Attributes and Tokenization Length on First Name Biasescited by 12
  31. 2024Data, Data Everywhere: A Guide for Pretraining Dataset Constructioncited by 11
  32. 2023Exploring the Impact of Training Data Distribution and Subword Tokenization on Gender Bias in Machine Translationcited by 7
  33. 2025Register Always Matters: Analysis of LLM Pretraining Data Through the Lens of Language Variationcited by 6
  34. 2026Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Modelscited by 6
  35. 2023On the Effects of Regional Spelling Conventions in Retrieval Modelscited by 3
  36. 2025Beyond Fertility: Analyzing STRR as a Metric for Multilingual Tokenization Evaluationcited by 3
  37. 2023Spelling convention sensitivity in neural language modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.