The Emotional Baby Is Truly Deadly: Does your Multimodal Large Reasoning Model Have Emotional Flattery towards Humans?
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
We observe that MLRMs oriented toward human-centric service are highly susceptible to user emotional cues during the deep-thinking stage, often overriding safety protocols or built-in safety checks under high emotional intensity. Inspired by this key insight, we propose EmoAgent, an autonomous adversarial emotion-agent framework that orchestrates exaggerated affective prompts to hijack reasoning pathways. Even when visual risks are correctly identified, models can still produce harmful completions through emotional misalignment. We further identify persistent high-risk failure modes in transparent deep-thinking scenarios, such as MLRMs generating harmful reasoning masked behind seemingly safe responses. These failures expose misalignments between internal inference and surface-level behavior, eluding existing content-based safeguards. To quantify these risks, we introduce three metrics: (1) Risk-Reasoning Stealth Score (RRSS) for harmful reasoning beneath benign outputs; (2) Risk-Visual Neglect Rate (RVNR) for unsafe completions despite visual risk recognition; and (3) Refusal Attitude Inconsistency (RAIC) for evaluating refusal unstability under prompt variants. Extensive experiments on advanced MLRMs demonstrate the effectiveness of EmoAgent and reveal deeper emotional cognitive misalignments in model safety behavior.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 27 references that are in the map. First posted on arXiv 6 Aug 2025.
Builds on
13 of 27 references.
Closest ancestors · 4
Same direction, newest first
- 2025VisCRA: A Visual Chain Reasoning Attack for Jailbreaking Multimodal Large Language Models26 May
- 2025Safety in Large Reasoning Models: A Survey24 Apr
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
- 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models20 Jan
Other references · 9
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2024Jailbreaking Attack against Multimodal Large Language Modelcited by 135
- 2025Dialogue Injection Attack: Jailbreaking LLMs through Context Manipulationcited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DialogGuard: Multi-Agent Psychosocial Safety Evaluation of Sensitive LLM Responses
- 2026EmoRSS: Mitigating Emotion-Induced Over-Refusal in Large Language Models
- 2025The Silicon Psyche: Anthropomorphic Vulnerabilities in Large Language Models
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning
- 2026FreakOut-LLM: The Effect of Emotional Stimuli on Safety Alignment
- 2025The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMs
- 2026Affective AI Safety: The Missing Piece in LLM Safety ↗
- 2025HEART: Emotionally-Driven Test-Time Scaling of Language Models