Auditing Framing-Sensitive Behavioral Instability in Large Language Models for Mental Health Interactions
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly being integrated into mental health support tools and other psychologically sensitive conversational applications. In such settings, behavioral stability and consistency are important for trustworthy human-AI interaction. However, semantically similar concerns can be presented through different contextual framings, potentially eliciting different model responses. Such framing-sensitive variability may challenge user expectations regarding system behavior and complicate the assessment of AI reliability. While prior studies have primarily examined such effects at the behavioral level, less is known about how framing-related variation is reflected in the internal representations of aligned language models. In this work, we investigate these effects using controlled matched prompts spanning multiple contextual framing conditions across several instruction-tuned model families. Across architectures, framing systematically alters interpretive response tendencies. Layer-wise probing analyses show that behavior-associated information remains decodable throughout transformer depth, with architecture-dependent variation in decoding strength. Moreover, held-out framing probes remained consistently above chance across architectures despite strong lexical baselines. Activation steering experiments further suggest that framing-associated representational directions can partially modulate downstream behavioral outcomes. Finally, these findings indicate that robustness to contextual variation may represent an important consideration when evaluating the consistency and trustworthiness of conversational AI systems deployed in mental-health-oriented interactions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
21 of 27 references.
References · 21
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
9 more
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 250
- 2022Predictability and Surprise in Large Generative Modelscited by 209
- 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 104
- 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 46
- 2025Sycophancy Is Not One Thing: Causal Separation of Sycophantic Behaviors in LLMscited by 32
- 2024A Causal Explainable Guardrails for Large Language Modelscited by 18
- 2025DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarioscited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Framing Matters: Addressing Framing Sensitivity in Decision-Making through Behaviorally-Grounded Value Alignment
- 2026Do Emotions in Prompts Matter? Effects of Emotional Framing on Large Language Models
- 2024Brittle Minds, Fixable Activations: Understanding Belief Representations in Language Models
- 2026Sympathetic Framing: Evaluating AI Alignment across Sociodemographic Groups
- 2025Accumulating Context Changes the Beliefs of Language Models
- 2026Human-Alignment, Calibration, and Activation Patterns in Large Language Model Uncertainty
- 2025Implicature in Interaction: Understanding Implicature Improves Alignment in Human-LLM Interaction
- 2025State-Dependent Refusal and Learned Incapacity in RLHF-Aligned Language Models