CuMA: Aligning LLMs with Sparse Cultural Values via Demographic-Aware Mixture of Adapters
Not on the map. Why?
Abstract (arXiv)
As Large Language Models (LLMs) serve a global audience, alignment must transition from enforcing universal consensus to respecting cultural pluralism. We demonstrate that dense models, when forced to fit conflicting value distributions, suffer from Mean Collapse, converging to a generic average that fails to represent diverse groups. We attribute this to Cultural Sparsity, where gradient interference prevents dense parameters from spanning distinct cultural modes. To resolve this, we propose textbftextscCuMA (Cultural Mixture of Adapters), a framework that frames alignment as a conditional capacity separation problem. By incorporating demographic-aware routing, textscCuMA internalizes a textitLatent Cultural Topology to explicitly disentangle conflicting gradients into specialized expert subspaces. Extensive evaluations on WorldValuesBench, Community Alignment, and PRISM demonstrate that textscCuMA achieves state-of-the-art performance, significantly outperforming both dense baselines and semantic-only MoEs. Crucially, our analysis confirms that textscCuMA effectively mitigates mean collapse, preserving cultural diversity. Our code is available at https://github.com/Throll/CuMA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
31 of 49 references.
References · 31
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Mixture-of-Experts with Expert Choice Routingcited by 611
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
19 more
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 402
- 2023Llemma: An Open Language Model For Mathematicscited by 385
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2024MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Expertscited by 144
- 2024WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Modelscited by 59
- 2025Improving LLM Safety Alignment with Dual-Objective Optimizationcited by 40
- 2024Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Freecited by 37
- 2024Can Language Models Reason about Individualistic Human Values and Preferences?cited by 34
- 2025Cultivating Pluralism In Algorithmic Monoculture: The Community Alignment Datasetcited by 32
- 2024Self-Pluralising Culture Alignment for Large Language Modelscited by 31
- 2025An Evaluation of Cultural Value Alignment in LLMcited by 28
- 2024Strong and weak alignment of large language models with human valuescited by 27
- 2023Reinforcement Learning from Diverse Human Preferencescited by 24
- 2024A Comparative Study on Annotation Quality of Crowdsourcing and LLM via Label Aggregationcited by 23
- 2025Culture is Everywhere: A Call for Intentionally Cultural Evaluationcited by 10
- 2024Adaptation Odyssey in LLMs: Why Does Additional Pretraining Sometimes Fail to Improve?cited by 8
- 2022Latent Topology Induction for Understanding Contextualized Representationscited by 7
- 2025ToReMi: Topic-Aware Data Reweighting for Dynamic Pre-Training Data Selectioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
- 2025DiverValue-Bench: A Benchmark and Fine-Tuning Framework for Aligning Large Language Models with Diverse Human Values
- 2026AlignCultura: Towards Culturally Aligned Large Language Models?
- 2025Whispers of Many Shores: Cultural Alignment through Collaborative Cultural Expertise
- 2025Cultural Alignment in Large Language Models Using Soft Prompt Tuning
- 2026Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory
- 2026Cross-Lingual Consensus: Aligning Multilingual Cultural Knowledge via Multilingual Self-Consistency
- 2025ALIGN: Word Association Learning for Cultural Alignment in Large Language Models