How Does "English (US)" Become the Default? Triangulating Structural Bias Towards American English Across the LLM Pipeline
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly embedded in educational, professional, and public infrastructure, yet widely used platforms expose "English (US)" as a primary English setting despite the global diversity of English. We ask: How does "English (US)" become the default? We study this question as structural bias, examining how geopolitical histories of data curation, digital dominance, and linguistic standardization intersect with the LLM development pipeline. Using British English as a controlled reference, we construct a curated resource of 1,813 matched American English (AmE)--British English (BrE) variants and introduce DiAlign, a dynamic, training-free method for estimating regional alignment from distributional evidence. We triangulate the AmE preference across data exposure --> representation --> generation, jointly examining pretraining and post-training data, tokenizer behavior and provenance, model prediction cost, and generated language across developer countries, prompt conditions, domains and sources, linguistic categories, and registers. AmE is consistently favored across all six audited pretraining corpora and 21 post-training datasets, is generally represented more compactly by tokenizers, and receives lower prediction cost. It also remains the dominant generation default under neutral English prompting; British-English prompting shifts this preference toward BrE but does not consistently eliminate the AmE default. To our knowledge, this is the first rigorous pipeline-wide study of structural bias across major phases of LLM development. Our findings show that contemporary LLMs privilege AmE as the de facto norm, raising concerns about linguistic homogenization, epistemic injustice, and inequity in global AI deployment, while providing a rigorous basis for targeted component-level intervention.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 85 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
49 of 85 references.
References · 49
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
- 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
- 2019ELI5: Long Form Question Answeringcited by 575
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
- 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
37 more
- 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 406
- 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
- 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
- 2021Understanding Dataset Difficulty with V-Usable Informationcited by 291
- 2024PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preferencecited by 261
- 2024HelpSteer2: Open-source dataset for training top-performing reward modelscited by 236
- 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
- 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
- 2016Demographic Dialectal Variation in Social Media: A Case Study of African-American Englishcited by 196
- 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 192
- 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 182
- 2024RedPajama: an Open Dataset for Training Large Language Modelscited by 182
- 2024QuRating: Selecting High-Quality Data for Training Language Modelscited by 157
- 2023What's In My Big Data?cited by 129
- 2023Large Language Models in Law: A Surveycited by 128
- 2023Tokenizer Choice For LLM Training: Negligible or Crucial?cited by 108
- 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curationcited by 76
- 2024Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discriminationcited by 56
- 2022Multi-VALUE: A Framework for Cross-Dialectal English NLPcited by 53
- 2024Open Problems in Technical AI Governancecited by 49
- 2022VALUE: Understanding Dialect Disparity in NLUcited by 47
- 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
- 2025Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Modelscited by 31
- 2023Data Portraits: Recording Foundation Model Training Datacited by 30
- 2020Learning to Recognize Dialect Featurescited by 29
- 2024Exploring Design Choices for Building Language-Specific LLMscited by 22
- 2025Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenizationcited by 20
- 2024Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarkscited by 17
- 2025Causal Estimation of Tokenisation Biascited by 16
- 2023Nichelle and Nancy: The Influence of Demographic Attributes and Tokenization Length on First Name Biasescited by 12
- 2024Data, Data Everywhere: A Guide for Pretraining Dataset Constructioncited by 11
- 2023Exploring the Impact of Training Data Distribution and Subword Tokenization on Gender Bias in Machine Translationcited by 7
- 2025Register Always Matters: Analysis of LLM Pretraining Data Through the Lens of Language Variationcited by 6
- 2026Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Modelscited by 6
- 2023On the Effects of Regional Spelling Conventions in Retrieval Modelscited by 3
- 2025Beyond Fertility: Analyzing STRR as a Metric for Multilingual Tokenization Evaluationcited by 3
- 2023Spelling convention sensitivity in neural language modelscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoderscited by 0
- 2026The Dialect Tax: Dialectal Biases Persist throughout the Language Modeling Pipelinecited by 0
- 2026Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resourcescited by 0
- 2026Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources13 Oct 2026
- 2026The Dialect Tax: Dialectal Biases Persist throughout the Language Modeling Pipeline24 Aug 2026
- 2026Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoders23 Jul 2026