mlsanityData to 14 Oct 2026

From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models

arXiv 2312.17256 ↗First posted 21 Dec 2023cs.CL cs.AI cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are able to engage in natural-sounding conversations with humans, showcasing unprecedented capabilities for information retrieval and automated decision support. They have disrupted human-technology interaction and the way businesses operate. However, technologies based on generative artificial intelligence (GenAI) are known to hallucinate, misinform, and display biases introduced by the massive datasets on which they are trained. Existing research indicates that humans may unconsciously internalize these biases, which can persist even after they stop using the programs. This study explores the cultural self-perception of LLMs by prompting ChatGPT (OpenAI) and Bard (Google) with value questions derived from the GLOBE project. The findings reveal that their cultural self-perception is most closely aligned with the values of English-speaking countries and countries characterized by sustained economic competitiveness. Recognizing the cultural biases of LLMs and understanding how they work is crucial for all members of society because one does not want the black box of artificial intelligence to perpetuate bias in humans, who might, in turn, inadvertently create and train even more biased algorithms.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 128 references that are in the map. First posted on arXiv 21 Dec 2023.

Builds on

38 of 128 references.

References · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  4. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  5. 2021Ethical and social risks of harm from Language Modelscited by 966
  6. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  7. 2018Self-Attention Generative Adversarial Networkscited by 809
  8. 2023Whose Opinions Do Language Models Reflect?cited by 773
  9. 2019How multilingual is Multilingual BERT?cited by 645
  10. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  11. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
  12. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
26 more
  1. 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 224
  2. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
  3. 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
  4. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  5. 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
  6. 2020Towards Debiasing Sentence Representationscited by 171
  7. 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
  8. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  9. 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 148
  10. 2017A Survey Of Cross-lingual Word Embedding Modelscited by 143
  11. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
  12. 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
  13. 2023Moral Foundations of Large Language Modelscited by 85
  14. 2023The Self-Perception and Political Biases of ChatGPTcited by 66
  15. 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 62
  16. 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
  17. 2023Do Large Language Models Show Decision Heuristics Similar to Humans? A Case Study Using GPT-3.5cited by 42
  18. 2022Large Language Models and the Reverse Turing Testcited by 38
  19. 2023Unveiling Gender Bias in Terms of Profession Across LLMs: Analyzing and Addressing Sociological Implicationscited by 29
  20. 2021Intersectional Bias in Causal Language Modelscited by 24
  21. 2022A Robust Bias Mitigation Procedure Based on the Stereotype Content Modelcited by 24
  22. 2023Are Emily and Greg Still More Employable than Lakisha and Jamal? Investigating Algorithmic Hiring Bias in the Era of ChatGPTcited by 24
  23. 2023CBBQ: A Chinese Bias Benchmark Dataset Curated with Human-AI Collaboration for Large Language Modelscited by 23
  24. 2023How susceptible are LLMs to Logical Fallacies?cited by 23
  25. 2023Citation: A Key to Building Responsible and Accountable Large Language Modelscited by 20
  26. 2023AI in the Gray: Exploring Moderation Policies in Dialogic Large Language Models vs. Human Answers in Controversial Topicscited by 12

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.