mlsanityData to 7 Oct 2026

Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Values

arXiv 2609.08515 ↗First posted 8 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As Large Language Models (LLMs) are increasingly integrated into human society, aligning them with pluralistic social values has become a critical priority. However, whether LLMs exhibit consistent value preferences across languages remains underexplored, particularly for culturally grounded values, which are more abstract and difficult to evaluate and align than safety-centric principles. We investigate this issue through Chinese Social Values (CSV), a value system rooted in Chinese culture and comprising 12 dimensions across national, societal, and personal levels. We construct C-Voices, the first comprehensive multilingual contrastive probe dataset for CSV, with 86,400 dilemma-based instances in six languages, each pairing a CSV-aligned action with a value-conflicting alternative. Building on the contrastive probes of C-Voices, we then propose a fine-tuning-free value vector steering method that derives value directions from hidden-state discrepancies and selectively intervenes on value-sensitive layers during inference. Experiments on six languages show that CSV-oriented preferences are model-dependent and language-sensitive, with the same dilemma eliciting divergent responses across languages. Our method achieves effective CSV steering, supports cross-lingual transfer of value vectors, and generalizes to existing FLAMES and ValuePrism.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

22 of 45 references.

References · 22

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2023Let's Verify Step by Stepcited by 3,598
  7. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  8. 2023LIMA: Less Is More for Alignmentcited by 1,080
  9. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  10. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  11. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  12. 2023Chain of Hindsight Aligns Language Models with Feedbackcited by 147
10 more
  1. 2024The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contextscited by 92
  2. 2025I Have Covered All the Bases Here: Interpreting Reasoning Features in Large Language Models via Sparse Autoencoderscited by 43
  3. 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
  4. 2024KorNAT: LLM Alignment Benchmark for Korean Social Values and Common Knowledgecited by 33
  5. 2023Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learningcited by 26
  6. 2024How Do Multilingual Language Models Remember Facts?cited by 20
  7. 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activationcited by 14
  8. 2026Selective Steering: Norm-Preserving Control Through Discriminative Layer Selectioncited by 4
  9. 2026Controllable Value Alignment in Large Language Models through Neuron-Level Editingcited by 3
  10. 2026Neural FOXP2 -- Language Specific Neuron Steering for Targeted Language Improvement in LLMscited by 1

Built on by

Not cited yet.