mlsanityData to 14 Oct 2026

The Cultural Gene of Large Language Models: A Study on the Impact of Cross-Corpus Training on Model Values and Biases

arXiv 2508.12411 ↗First posted 17 Aug 2025cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are deployed globally, yet their underlying cultural and ethical assumptions remain underexplored. We propose the notion of a "cultural gene" -- a systematic value orientation that LLMs inherit from their training corpora -- and introduce a Cultural Probe Dataset (CPD) of 200 prompts targeting two classic cross-cultural dimensions: Individualism-Collectivism (IDV) and Power Distance (PDI). Using standardized zero-shot prompts, we compare a Western-centric model (GPT-4) and an Eastern-centric model (ERNIE Bot). Human annotation shows significant and consistent divergence across both dimensions. GPT-4 exhibits individualistic and low-power-distance tendencies (IDV score approx 1.21; PDI score approx -1.05), while ERNIE Bot shows collectivistic and higher-power-distance tendencies (IDV approx -0.89; PDI approx 0.76); differences are statistically significant (p < 0.001). We further compute a Cultural Alignment Index (CAI) against Hofstede's national scores and find GPT-4 aligns more closely with the USA (e.g., IDV CAI approx 0.91; PDI CAI approx 0.88) whereas ERNIE Bot aligns more closely with China (IDV CAI approx 0.85; PDI CAI approx 0.81). Qualitative analyses of dilemma resolution and authority-related judgments illustrate how these orientations surface in reasoning. Our results support the view that LLMs function as statistical mirrors of their cultural corpora and motivate culturally aware evaluation and deployment to avoid algorithmic cultural hegemony.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 65 references that are in the map. First posted on arXiv 17 Aug 2025.

Builds on

33 of 65 references.

References · 33

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  4. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  5. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  6. 2019Language Models as Knowledge Bases?cited by 1,936
  7. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  8. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  9. 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
  10. 2021Ethical and social risks of harm from Language Modelscited by 966
  11. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  12. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
21 more
  1. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  2. 2023Whose Opinions Do Language Models Reflect?cited by 773
  3. 2020Aligning AI With Shared Human Valuescited by 723
  4. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  5. 2019On Measuring Social Biases in Sentence Encoderscited by 398
  6. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 349
  7. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 296
  8. 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
  9. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
  10. 2019Analyzing the Structure of Attention in a Transformer Language Modelcited by 243
  11. 2020Experience Grounds Languagecited by 242
  12. 2022In-context Reinforcement Learning with Algorithm Distillationcited by 190
  13. 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
  14. 2021Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Modelscited by 131
  15. 2023Do Multilingual Language Models Think Better in English?cited by 88
  16. 2021Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoningcited by 65
  17. 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Linecited by 50
  18. 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
  19. 2025Learning from Heterogeneity: Generalizing Dynamic Facial Expression Recognition via Distributionally Robust Optimizationcited by 19
  20. 2023ReSup: Reliable Label Noise Suppression for Facial Expression Recognitioncited by 14
  21. 2024Unified Static and Dynamic Network: Efficient Temporal Filtering for Video Groundingcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.