mlsanityData to 14 Oct 2026

CoCoA: Context-Conditional Cultural Alignment for Large Language Models

arXiv 2608.29492 ↗First posted 30 Aug 2026cs.CLcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Large Language Models (LLMs) often favor Western-associated entities across cultural contexts. Conventional debiasing methods aim for uniform neutrality, but cultural bias mitigation demands context-conditional behavior, preferring culturally appropriate entities when cultural cues are present and remaining neutral when they are absent. We propose CoCoA (Context-Conditional Cultural Alignment), a framework that learns this behavior through dual-context training on the same entity pairs under contexts with and without cultural cues. CoCoA combines a contrastive alignment objective with calibration and drift regularization, optimized through goal-aware gradient reconciliation. We evaluate CoCoA on CAMeL and Camellia, two entity-centric cultural bias benchmarks, across ten language settings and four LLMs. CoCoA reduces the Cultural Bias Score from 43 to 24 on average while maintaining near-neutral preferences at 50.2, with minimal impact on general performance across five standard benchmarks. These findings highlight that effective cultural alignment requires context-conditional modeling rather than uniform debiasing, and establish a new direction for mitigating entity-centric cultural bias in LLMs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 24 of its 32 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

24 of 32 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025CARE: Multilingual Human Preference Learning for Cultural Awareness7 Apr
  2. 2024Investigating Cultural Alignment of Large Language Models20 Feb

Other references · 22

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  3. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  4. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  5. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  6. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  7. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  8. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  9. 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
  10. 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 173
  11. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
  12. 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
10 more
  1. 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
  2. 2024Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Modelscited by 24
  3. 2025BiasEdit: Debiasing Stereotyped Language Models via Model Editingcited by 18
  4. 2025Commonsense Reasoning in Arab Culturecited by 16
  5. 2025CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesiscited by 15
  6. 2025Mitigating Biases in Language Models via Bias Unlearningcited by 6
  7. 2025Bias Mitigation or Cultural Commonsense? Evaluating LLMs with a Japanese Datasetcited by 2
  8. 2026CALM: Culturally Self-Aware Language Modelscited by 2
  9. 2026Cultural Authenticity: Comparing LLM Cultural Representations to Native Human Expectationscited by 1
  10. 2026Learning to Route Languages for Multilingual Policy Optimizationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
  2. 2026AlignCultura: Towards Culturally Aligned Large Language Models?
  3. 2024Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learning
  4. 2025ALIGN: Word Association Learning for Cultural Alignment in Large Language Models
  5. 2026Prompt Programming for Cultural Bias and Alignment of Large Language Models
  6. 2026Cross-Lingual Consensus: Aligning Multilingual Cultural Knowledge via Multilingual Self-Consistency
  7. 2025Cultural Alignment in Large Language Models Using Soft Prompt Tuning
  8. 2025Whispers of Many Shores: Cultural Alignment through Collaborative Cultural Expertise