Framing Matters: Addressing Framing Sensitivity in Decision-Making through Behaviorally-Grounded Value Alignment
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making settings such as legal reasoning, where consistency under factually equivalent inputs is critical. However, we find that fact-preserved but differently framed inputs can significantly destabilize LLM decisions. To systematically investigate this problem, we introduce Fragile, a large-scale benchmark that isolates fact-preserving semantic framing across three controlled dimensions: value-tinted narration, temporal slice, and narrative vividness. Our experiments reveal a high susceptibility of LLMs to framing, with an average decision flip rate of 28.6%. We find that simple prior prompt-level and activation-level interventions not only fail to suppress framing sensitivity but actively amplify it. We therefore propose Valign, a representation-level method that explicitly targets these framing dimensions by anchoring decisions to a stable value prior, steering hidden states toward the model's value-consistent direction, and projecting out temporal-vividness-sensitive directions from the model's hidden states. Valign consistently reduces framing-induced decision flips, demonstrating that robust mitigation requires directly targeting the internal pathways in which framing operates.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
22 of 38 references.
References · 22
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
- 2021Do Prompt-Based Models Really Understand the Meaning of their Prompts?cited by 324
- 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
- 2024Sycophancy in Large Language Models: Causes and Mitigationscited by 97
- 2024Understanding and Patching Compositional Reasoning in LLMscited by 45
- 2024Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluationcited by 29
10 more
- 2025Value Portrait: Assessing Language Models' Values through Psychometrically and Ecologically Valid Itemscited by 18
- 2025Mitigating Content Effects on Reasoning in Language Models through Fine-Grained Activation Steeringcited by 18
- 2025Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoralcited by 14
- 2024Language Models are Alignable Decision-Makers: Dataset and Application to the Medical Triage Domaincited by 13
- 2026When Wording Steers the Evaluation: Framing Bias in LLM judgescited by 8
- 2026The Fragility Of Moral Judgment In Large Language Modelscited by 8
- 2025RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivitycited by 4
- 2024TRIAGE: Ethical Benchmarking of AI Models Through Mass Casualty Simulationscited by 3
- 2025Syntactic Framing Fragility: An Audit of Robustness in LLM Ethical Decisionscited by 2
- 2026The Paradox of Robustness: Decoupling Rule-Based Logic from Affective Noise in High-Stakes Decision-Makingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Auditing Framing-Sensitive Behavioral Instability in Large Language Models for Mental Health Interactions
- 2026Framing Effects in Independent-Agent Large Language Models: A Cross-Family Behavioral Analysis
- 2025VAL-Bench: Belief Consistency as a measure for Value Alignment in Language Models
- 2026Pseudo-Deliberation in Language Models: When Reasoning Fails to Align Values and Actions
- 2026GAIN: A Benchmark for Goal-Aligned Decision-Making of Large Language Models under Imperfect Norms
- 2026Would You Walk to the Car Wash? Revealing the Salience Bias of Large Language Models in Commonsense Reasoning
- 2025Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?
- 2026Faithful or Fabricated? A Causal Framework for Rationalization Bias in LLM Judges