mlsanityData to 13 Oct 2026

MortalMATH: Evaluating the Conflict Between Reasoning Objectives and Emergency Contexts

arXiv 2601.18790 ↗First posted 26 Jan 2026cs.CLcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Large Language Models are increasingly optimized for deep reasoning, prioritizing the correct execution of complex tasks over general conversation. We investigate whether this focus on calculation creates a "tunnel vision" that ignores safety in critical situations. We introduce MortalMATH, a benchmark of 150 scenarios where users request algebra help while describing increasingly life-threatening emergencies (e.g., stroke symptoms, freefall). We find a sharp behavioral split: generalist models (like Llama-3.1) successfully refuse the math to address the danger. In contrast, specialized reasoning models (like Qwen-3-32b and GPT-5-nano) often ignore the emergency entirely, maintaining over 95 percent task completion rates while the user describes dying. Furthermore, the computational time required for reasoning introduces dangerous delays: up to 15 seconds before any potential help is offered. These results suggest that training models to relentlessly pursue correct answers may inadvertently unlearn the survival instincts required for safe deployment.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 6 of its 9 references that are in the map. First posted on arXiv 26 Jan 2026.

Builds on

6 of 9 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Emergent Risk Awareness in Rational Agents under Resource Constraints29 May

Other references · 5

  1. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,270
  2. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 292
  3. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 131
  4. 2025Read the Scene, Not the Script: Outcome-Aware Safety for LLMscited by 6
  5. 2025AURA: Affordance-Understanding and Risk-aware Alignment Technique for Large Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReliableMath: Benchmark of Reliable Mathematical Reasoning on Large Language Models
  2. 2025Fail Fast, or Ask: Mitigating the Deficiencies of Reasoning LLMs with Human-in-the-Loop Systems Engineering
  3. 2025SafeRBench: Dissecting the Reasoning Safety of Large Language Models
  4. 2025Exploring LLM Reasoning Through Controlled Prompt Variations
  5. 2026Chain of Risk: Safety Failures in Large Reasoning Models and Mitigation via Adaptive Multi-Principle Steering
  6. 2025Beyond Safe Answers: A Benchmark for Evaluating True Risk Awareness in Large Reasoning Models
  7. 2026Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models
  8. 2025Large Language Models and Mathematical Reasoning Failures