mlsanityData to 14 Oct 2026

WorldView-Bench: A Benchmark for Evaluating Global Cultural Perspectives in Large Language Models

arXiv 2505.09595 ↗First posted 14 May 2025cs.CL cs.AI cs.CYcited by 5

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are predominantly trained and aligned in ways that reinforce Western-centric epistemologies and socio-cultural norms, leading to cultural homogenization and limiting their ability to reflect global civilizational plurality. Existing benchmarking frameworks fail to adequately capture this bias, as they rely on rigid, closed-form assessments that overlook the complexity of cultural inclusivity. To address this, we introduce WorldView-Bench, a benchmark designed to evaluate Global Cultural Inclusivity (GCI) in LLMs by analyzing their ability to accommodate diverse worldviews. Our approach is grounded in the Multiplex Worldview proposed by Senturk et al., which distinguishes between Uniplex models, reinforcing cultural homogenization, and Multiplex models, which integrate diverse perspectives. WorldView-Bench measures Cultural Polarization, the exclusion of alternative perspectives, through free-form generative evaluation rather than conventional categorical benchmarks. We implement applied multiplexity through two intervention strategies: (1) Contextually-Implemented Multiplex LLMs, where system prompts embed multiplexity principles, and (2) Multi-Agent System (MAS)-Implemented Multiplex LLMs, where multiple LLM agents representing distinct cultural perspectives collaboratively generate responses. Our results demonstrate a significant increase in Perspectives Distribution Score (PDS) entropy from 13% at baseline to 94% with MAS-Implemented Multiplex LLMs, alongside a shift toward positive sentiment (67.7%) and enhanced cultural balance. These findings highlight the potential of multiplex-aware AI evaluation in mitigating cultural bias in LLMs, paving the way for more inclusive and ethically aligned AI systems.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 38 of its 76 references that are in the map. First posted on arXiv 14 May 2025.

Builds on

38 of 76 references.

References · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  8. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  10. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  11. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  12. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
26 more
  1. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  2. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  3. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 748
  4. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  5. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
  6. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  7. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
  8. 2023Instruction Tuning with GPT-4cited by 686
  9. 2018CoQA: A Conversational Question Answering Challengecited by 683
  10. 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 408
  11. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
  12. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
  13. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
  14. 2023The False Promise of Imitating Proprietary LLMscited by 263
  15. 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 173
  16. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  17. 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
  18. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
  19. 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
  20. 2025Fanar: An Arabic-Centric Multimodal Generative AI Platformcited by 67
  21. 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
  22. 2022MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversationcited by 56
  23. 2025Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Abovecited by 52
  24. 2023Bias and Fairness in Chatbots: An Overviewcited by 20
  25. 2023A Critical Re-evaluation of Benchmark Datasets for (Deep) Learning-Based Matching Algorithmscited by 4
  26. 2025Toward Inclusive Educational AI: Auditing Frontier LLMs through a Multiplexity Lenscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models
  2. 2026Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
  3. 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries
  4. 2025Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
  5. 2024All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languages
  6. 2025MMA-ASIA: A Multilingual and Multimodal Alignment Framework for Culturally-Grounded Evaluation
  7. 2025CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesis
  8. 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models