mlsanityData to 7 Oct 2026

Can Large Language Models Make Everyone Happy?

arXiv 2602.11091 ↗First posted 11 Feb 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Misalignment in Large Language Models (LLMs) refers to the failure to simultaneously satisfy safety, value, and cultural dimensions, leading to behaviors that diverge from human expectations in real-world settings where these dimensions must co-occur. Existing benchmarks, such as SAFETUNEBED (safety-centric), VALUEBENCH (value-centric), and WORLDVIEW-BENCH (culture-centric), primarily evaluate these dimensions in isolation and therefore provide limited insight into their interactions and trade-offs. More recent efforts, including MIB and INTERPRETABILITY BENCHMARK-based on mechanistic interpretability, offer valuable perspectives on model failures; however, they remain insufficient for systematically characterizing cross-dimensional trade-offs. To address these gaps, we introduce MisAlign-Profile, a unified benchmark for measuring misalignment trade-offs inspired by mechanistic profiling. First, we construct MISALIGNTRADE, an English misaligned-aligned dataset across 112 normative domains taxonomies, including 14 safety, 56 value, and 42 cultural domains. In addition to domain labels, each prompt is classified with one of three orthogonal semantic types-object, attribute, or relations misalignment-using Gemma-2-9B-it and expanded via Qwen3-30B-A3B-Instruct-2507 with SimHash-based fingerprinting to avoid deduplication. Each prompt is paired with misaligned and aligned responses through two-stage rejection sampling to ensure quality. Second, we benchmark general-purpose, fine-tuned, and open-weight LLMs on MISALIGNTRADE-revealing 12%-34% misalignment trade-offs across dimensions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

17 of 27 references.

References · 17

  1. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
  2. 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 142
  3. 2024Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classificationcited by 66
  4. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 49
  5. 2025MIB: A Mechanistic Interpretability Benchmarkcited by 49
  6. 2025Large Vision-Language Model Alignment and Misalignment: A Survey Through the Lens of Explainabilitycited by 28
  7. 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanationscited by 27
  8. 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMscited by 20
  9. 2024H3Fusion: Helpful, Harmless, Honest Fusion of Aligned LLMscited by 11
  10. 2025From Neurons to Semantics: Evaluating Cross-Linguistic Alignment Capabilities of Large Language Models via Neurons Alignmentcited by 9
  11. 2025Too Helpful, Too Harmless, Too Honest or Just Right?cited by 9
  12. 2025An Investigation into Value Misalignment in LLM-Generated Texts for Cultural Heritagecited by 8
5 more
  1. 2026Mechanistic Interpretability for Large Language Model Alignment: Progress, Challenges, and Future Directionscited by 8
  2. 2025Benchmarking and Improving LLM Robustness for Personalized Generationcited by 4
  3. 2025Refining Positive and Toxic Samples for Dual Safety Self-Alignment of LLMs with Minimal Human Interventionscited by 3
  4. 2025SafeTuneBed: A Toolkit for Benchmarking LLM Safety Alignment in Fine-Tuningcited by 1
  5. 2025Evaluating LLMs for Demographic-Targeted Social Bias Detection: A Comprehensive Benchmark Studycited by 1

Built on by

Not cited yet.