Detecting and Steering LLMs' Empathy in Action
Not on the map. Why?
Abstract (arXiv)
We investigate empathy-in-action -- the willingness to sacrifice task efficiency to address human needs -- as a linear direction in LLM activation space. Using contrastive prompts grounded in the Empathy-in-Action (EIA) benchmark, we test detection and steering across Phi-3-mini-4k (3.8B), Qwen2.5-7B (safety-trained), and Dolphin-Llama-3.1-8B (uncensored). Detection: All models show AUROC 0.996-1.00 at optimal layers. Uncensored Dolphin matches safety-trained models, demonstrating empathy encoding emerges independent of safety training. Phi-3 probes correlate strongly with EIA behavioral scores (r=0.71, p<0.01). Cross-model probe agreement is limited (Qwen: r=-0.06, Dolphin: r=0.18), revealing architecture-specific implementations despite convergent detection. Steering: Qwen achieves 65.3% success with bidirectional control and coherence at extreme interventions. Phi-3 shows 61.7% success with similar coherence. Dolphin exhibits asymmetric steerability: 94.4% success for pro-empathy steering but catastrophic breakdown for anti-empathy (empty outputs, code artifacts). Implications: The detection-steering gap varies by model. Qwen and Phi-3 maintain bidirectional coherence; Dolphin shows robustness only for empathy enhancement. Safety training may affect steering robustness rather than preventing manipulation, though validation across more models is needed.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 11 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
9 of 11 references.
References · 9
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2022Toy Models of Superpositioncited by 928
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
- 2023Catastrophic Jailbreak of Open-source LLMs via Exploiting Generationcited by 439
- 2013Exploiting Similarities among Languages for Machine Translationcited by 187
- 2023Mechanistically analyzing the effects of fine-tuning on procedurally defined taskscited by 110
- 2017Offline bilingual word vectors, orthogonal transformations and the inverted softmaxcited by 94
Built on by
Citing papers per year: 2026: 1.
1 paper.