ValueGround: Evaluating Culture-Conditioned Visual Value Grounding in MLLMs
Not on the map. Why?
Abstract (arXiv)
Cultural values are expressed not only through language but also through visual scenes and everyday social practices. Yet existing evaluations of cultural values in language models are almost entirely text-only, leaving it unclear whether culture-conditioned judgments remain stable when response options are visualized. We introduce ValueGround, a benchmark for evaluating culture-conditioned visual value grounding in multimodal large language models (MLLMs). Built from World Values Survey questions, ValueGround uses minimally contrastive image pairs to represent opposing response options while controlling irrelevant variation. Given a country, a question, and an image pair, a model must choose the image that best matches the country's value tendency without access to the original response-option texts. Experiments across six MLLMs and 13 countries show that models perform substantially worse with visualized response options than with the original textual options, with average accuracy dropping from 72.8% to 62.6%. Our benchmark provides a controlled testbed for studying cross-modal transfer of culture-conditioned value judgments.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 42 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
20 of 42 references.
References · 20
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
- 2021Visually Grounded Reasoning across Languages and Culturescited by 189
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
- 2024Investigating Cultural Alignment of Large Language Modelscited by 143
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 101
- 2024WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Modelscited by 60
- 2024All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languagescited by 55
- 2023GeoDE: a Geographically Diverse Evaluation Dataset for Object Recognitioncited by 50
8 more
- 2024MIBench: Evaluating Multimodal Large Language Models over Multiple Imagescited by 39
- 2024Assessment of Multimodal Large Language Models in Alignment with Human Valuescited by 36
- 2024Looking Beyond Text: Reducing Language bias in Large Vision-Language Models via Multimodal Dual-Attention and Soft-Image Guidancecited by 32
- 2024Self-Pluralising Culture Alignment for Large Language Modelscited by 31
- 2025OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preferencecited by 28
- 2025GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarkingcited by 16
- 2025Beyond Words: Exploring Cultural Value Sensitivity in Multimodal Modelscited by 14
- 2025Zhyper: Factorized Hypernetworks for Conditioned LLM Fine-Tuningcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Scenario-based Probing and Steering Cultural Values in Large Language Models--Extended Version
- 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries
- 2026CrossCult-KIBench: A Benchmark for Cross-Cultural Knowledge Insertion in MLLMs
- 2025Grounding Multilingual Multimodal LLMs With Cultural Knowledge
- 2025MMA-ASIA: A Multilingual and Multimodal Alignment Framework for Culturally-Grounded Evaluation
- 2025BLEnD-Vis: Benchmarking Multimodal Cultural Understanding in Vision Language Models
- 2026Cultural Value Alignment Via Latent Activation Steering in Large Language Models
- 2026Debiasing Text-to-Image Evaluation via Implicit Cultural Alignment Reward Modeling