The Cultural Gene of Large Language Models: A Study on the Impact of Cross-Corpus Training on Model Values and Biases
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are deployed globally, yet their underlying cultural and ethical assumptions remain underexplored. We propose the notion of a "cultural gene" -- a systematic value orientation that LLMs inherit from their training corpora -- and introduce a Cultural Probe Dataset (CPD) of 200 prompts targeting two classic cross-cultural dimensions: Individualism-Collectivism (IDV) and Power Distance (PDI). Using standardized zero-shot prompts, we compare a Western-centric model (GPT-4) and an Eastern-centric model (ERNIE Bot). Human annotation shows significant and consistent divergence across both dimensions. GPT-4 exhibits individualistic and low-power-distance tendencies (IDV score approx 1.21; PDI score approx -1.05), while ERNIE Bot shows collectivistic and higher-power-distance tendencies (IDV approx -0.89; PDI approx 0.76); differences are statistically significant (p < 0.001). We further compute a Cultural Alignment Index (CAI) against Hofstede's national scores and find GPT-4 aligns more closely with the USA (e.g., IDV CAI approx 0.91; PDI CAI approx 0.88) whereas ERNIE Bot aligns more closely with China (IDV CAI approx 0.85; PDI CAI approx 0.81). Qualitative analyses of dilemma resolution and authority-related judgments illustrate how these orientations surface in reasoning. Our results support the view that LLMs function as statistical mirrors of their cultural corpora and motivate culturally aware evaluation and deployment to avoid algorithmic cultural hegemony.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 65 references that are in the map. First posted on arXiv 17 Aug 2025.
Builds on
33 of 65 references.
References · 33
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
21 more
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2020Aligning AI With Shared Human Valuescited by 723
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
- 2019On Measuring Social Biases in Sentence Encoderscited by 398
- 2021AI and the Everything in the Whole Wide World Benchmarkcited by 349
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 296
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
- 2019Analyzing the Structure of Attention in a Transformer Language Modelcited by 243
- 2020Experience Grounds Languagecited by 242
- 2022In-context Reinforcement Learning with Algorithm Distillationcited by 190
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
- 2021Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Modelscited by 131
- 2023Do Multilingual Language Models Think Better in English?cited by 88
- 2021Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoningcited by 65
- 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Linecited by 50
- 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
- 2025Learning from Heterogeneity: Generalizing Dynamic Facial Expression Recognition via Distributionally Robust Optimizationcited by 19
- 2023ReSup: Reliable Label Noise Suppression for Facial Expression Recognitioncited by 14
- 2024Unified Static and Dynamic Network: Efficient Temporal Filtering for Video Groundingcited by 12
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Beyond Instrumental and Substitutive Paradigms: Introducing Machine Culture as an Emergent Phenomenon in Large Language Modelscited by 0
- 2026AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Modelscited by 0
- 2026Computational Orientalism: Measuring Structural Discourse Bias in Large Language Models Using the Middle East Cultural Sensitivity Score (MECSS)cited by 0
- 2026Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Preventioncited by 0
- 2026Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Prevention20 Jul 2026
- 2026Computational Orientalism: Measuring Structural Discourse Bias in Large Language Models Using the Middle East Cultural Sensitivity Score (MECSS)9 Jun 2026
- 2026AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Models9 Mar 2026
- 2026Beyond Instrumental and Substitutive Paradigms: Introducing Machine Culture as an Emergent Phenomenon in Large Language Models23 Jan 2026