Occupational Prompting Reveals Cultural Bias in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Social roles shape expectations, priorities, and judgments, yet it remains unclear how large language models (LLMs) associate occupational identities with broader cultural value patterns. Prior work used nationality-based cultural prompting to study how LLM responses to value-survey questions align with human cultural benchmarks. In this paper, we extend that framework by replacing cultural prompting with occupational prompting to examine how professional-role cues influence value-survey responses in open-weight LLMs. Using a survey-grounded evaluation pipeline based on questions from the Integrated Values Surveys, we project model responses into the two-dimensional Inglehart--Welzel cultural space. We prompt open-weight LLMs to answer questions under occupational identities such as accountant, teacher, engineer, and nurse, and then analyze how these occupation-conditioned responses are positioned on the cultural map. Our results show that when open-weight LLMs are prompted with occupations rather than national identities, their responses remain within a broadly Western-leaning region of the cultural map. However, different occupations introduce shifts within this region, producing distinct occupational skews. This indicates that occupational prompts are not treated as neutral role labels, but instead elicit structured value patterns. These findings extend survey-based evaluation of cultural bias beyond nationality-based prompting and provide a framework for studying how occupational personas shape value expression in LLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
25 of 40 references.
References · 25
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 244
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
- 2023Gender bias and stereotypes in Large Language Modelscited by 187
- 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 175
- 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2024Investigating Cultural Alignment of Large Language Modelscited by 143
- 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
- 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
13 more
- 2024WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Modelscited by 60
- 2025The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Modelscited by 42
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 37
- 2023Large Language Models as Annotators: Enhancing Generalization of NLP Models at Minimal Costcited by 33
- 2023Bias in News Summarization: Measures, Pitfalls and Corporacited by 18
- 2024Do LLMs have Consistent Values?cited by 14
- 2024Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applicationscited by 10
- 2025Culture is Everywhere: A Call for Intentionally Cultural Evaluationcited by 10
- 2025Should LLMs be WEIRD? Exploring WEIRDness and Human Rights in Large Language Modelscited by 7
- 2024Smart Audit System Empowered by LLMcited by 4
- 2026Culturally Grounded Personas in Large Language Models: Characterization and Alignment with Socio-Psychological Value Frameworkscited by 3
- 2024LLM Bias Evaluation: Gender, Racial, and Age Disparities in Occupational and Crime Scenarioscited by 2
- 2026Prompt Programming for Cultural Bias and Alignment of Large Language Modelscited by 1
Built on by
Not cited yet.