mlsanityData to 7 Oct 2026

What Users Cannot See: Evaluating LLM Emotional Support Beyond User Preference

arXiv 2605.21569 ↗First posted 20 May 2026cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

People increasingly turn to LLMs for emotional support, yet common evaluations reward responses that feel helpful and may miss consequential response behaviors. We introduce a theory-informed measurement framework that decomposes LLM emotional-support responses into Soothe (affective comfort), Reframe (cognitive perspective-shift), and Endorse (agreement with a user's causal or moral framing). Across 9,000 GPT-5.6 responses to 3,000 venting and advice-seeking Reddit posts, friend- and therapist-style personas both increased Soothe relative to default but moved Reframe and Endorse in opposite directions: friend prompting increased Endorse and reduced Reframe, a pattern that could reinforce users' existing appraisals and plausibly contribute to escalation risk, whereas therapist prompting did the reverse. Two independent LLM judges substantially agreed with clinically trained raters, yet lay raters detected only 60% of expert-confirmed Endorse instances and rated the personas similarly helpful and desirable. Preference-based evaluation thus has a blind spot: supportive presentation can obscure appraisal-reinforcing, potentially escalatory behavior.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 May 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026CAREBench: Evaluating LLMs' Emotion Understanding by Assessing Cognitive Appraisal Reasoning
  2. 2025From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment
  3. 2025Incongruent Positivity: When Miscalibrated Positivity Undermines Online Supportive Conversations
  4. 2025Being Kind Isn't Always Being Safe: Diagnosing Affective Hallucination in LLMs
  5. 2026Whose Assessment of Distress? Community Perspectives and LLM Alignment on Well-Being Posts
  6. 2026Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversations
  7. 2026From Momentary Emotion Inference to Sustained Emotion Support: Evaluating a Companion Agent in a Longitudinal Study
  8. 2024Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversation