Do Large Language Models Adapt to Language Variation across Socioeconomic Status?
Not on the map. Why?
Abstract (arXiv)
Humans adjust their linguistic style to the audience they are addressing. However, the extent to which LLMs adapt to different social contexts is largely unknown. As these models increasingly mediate human-to-human communication, their failure to adapt to diverse styles can perpetuate stereotypes and marginalize communities whose linguistic norms are less closely mirrored by the models, thereby reinforcing social stratification. We study the extent to which LLMs integrate into social media communication across different socioeconomic status (SES) communities. We collect a novel dataset from Reddit and YouTube, stratified by SES. We prompt four LLMs with incomplete text from that corpus and compare the LLM-generated completions to the originals along 94 sociolinguistic metrics, including syntactic, rhetorical, and lexical features. LLMs modulate their style with respect to SES to only a minor extent, often resulting in approximation or caricature, and tend to emulate the style of upper SES more effectively. Our findings (1) show how LLMs risk amplifying linguistic hierarchies and (2) call into question their validity for agent-based social simulation, survey experiments, and any research relying on language style as a social signal.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 79 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
15 of 79 references.
References · 15
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
- 2024Factuality of Large Language Models: A Surveycited by 64
- 2023Contrasting Linguistic Patterns in Human and LLM-Generated News Textcited by 62
- 2024Do LLMs write like humans? Variation in grammatical and rhetorical stylescited by 62
- 2023Anatomy of an AI-powered malicious social botnetcited by 35
- 2025The AI Gap: How Socioeconomic Status Affects Language Technology Interactionscited by 15
- 2024Classist Tools: Social Class Correlates with Performance in NLPcited by 9
Built on by
Not cited yet.