WorldView-Bench: A Benchmark for Evaluating Global Cultural Perspectives in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are predominantly trained and aligned in ways that reinforce Western-centric epistemologies and socio-cultural norms, leading to cultural homogenization and limiting their ability to reflect global civilizational plurality. Existing benchmarking frameworks fail to adequately capture this bias, as they rely on rigid, closed-form assessments that overlook the complexity of cultural inclusivity. To address this, we introduce WorldView-Bench, a benchmark designed to evaluate Global Cultural Inclusivity (GCI) in LLMs by analyzing their ability to accommodate diverse worldviews. Our approach is grounded in the Multiplex Worldview proposed by Senturk et al., which distinguishes between Uniplex models, reinforcing cultural homogenization, and Multiplex models, which integrate diverse perspectives. WorldView-Bench measures Cultural Polarization, the exclusion of alternative perspectives, through free-form generative evaluation rather than conventional categorical benchmarks. We implement applied multiplexity through two intervention strategies: (1) Contextually-Implemented Multiplex LLMs, where system prompts embed multiplexity principles, and (2) Multi-Agent System (MAS)-Implemented Multiplex LLMs, where multiple LLM agents representing distinct cultural perspectives collaboratively generate responses. Our results demonstrate a significant increase in Perspectives Distribution Score (PDS) entropy from 13% at baseline to 94% with MAS-Implemented Multiplex LLMs, alongside a shift toward positive sentiment (67.7%) and enhanced cultural balance. These findings highlight the potential of multiplex-aware AI evaluation in mitigating cultural bias in LLMs, paving the way for more inclusive and ethically aligned AI systems.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 38 of its 76 references that are in the map. First posted on arXiv 14 May 2025.
Builds on
38 of 76 references.
References · 38
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
26 more
- 2023Large Language Models are not Fair Evaluatorscited by 1,085
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
- 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 748
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
- 2023Instruction Tuning with GPT-4cited by 686
- 2018CoQA: A Conversational Question Answering Challengecited by 683
- 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 408
- 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
- 2023The False Promise of Imitating Proprietary LLMscited by 263
- 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 173
- 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
- 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
- 2025Fanar: An Arabic-Centric Multimodal Generative AI Platformcited by 67
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
- 2022MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversationcited by 56
- 2025Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Abovecited by 52
- 2023Bias and Fairness in Chatbots: An Overviewcited by 20
- 2023A Critical Re-evaluation of Benchmark Datasets for (Deep) Learning-Based Matching Algorithmscited by 4
- 2025Toward Inclusive Educational AI: Auditing Frontier LLMs through a Multiplexity Lenscited by 2
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoningcited by 4
- 2025Identity-Aware Large Language Models require Cultural Reasoningcited by 4
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culturecited by 1
- 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebookcited by 1
- 2025Dissecting Physics Reasoning in Small Language Models: A Multi-Dimensional Analysis from an Educational Perspectivecited by 0
- 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook16 Mar 2026
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture5 Nov 2025
- 2025Identity-Aware Large Language Models require Cultural Reasoning21 Oct 2025
- 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning25 Sep 2025
- 2025Dissecting Physics Reasoning in Small Language Models: A Multi-Dimensional Analysis from an Educational Perspective27 May 2025
Similar, not cited
Close in wording, no citation either way
- 2023CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models
- 2026Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
- 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries
- 2025Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
- 2024All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languages
- 2025MMA-ASIA: A Multilingual and Multimodal Alignment Framework for Culturally-Grounded Evaluation
- 2025CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesis
- 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models