Reasoning Hijacking: The Fragility of Reasoning Alignment in Large Language Models
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Current LLM safety research predominantly focuses on mitigating Goal Hijacking, preventing attackers from redirecting a model's high-level objective (e.g., from "summarizing emails" to "phishing users"). In this paper, we argue that this perspective is incomplete and highlight a critical vulnerability in Reasoning Alignment. We expose the inherent fragility of current alignment techniques by proposing a new adversarial prompt attack paradigm: Reasoning Hijacking. To demonstrate this vulnerability, we instantiate it via the Criteria Attack, which subverts model judgments by injecting spurious decision criteria without altering the high-level task goal. Unlike Goal Hijacking, which attempts to override the system prompt, Reasoning Hijacking keeps the task goal intact but manipulates the model's decision-making logic by injecting spurious reasoning shortcuts. Through extensive experiments on three different tasks (toxic comment, negative review, and spam detection), we demonstrate that even state-of-the-art models are highly fragile, consistently prioritizing injected heuristic shortcuts over rigorous semantic analysis. Crucially, because the model's explicit intent remains aligned with the user's instructions, these attacks can bypass defenses designed to detect goal deviation (e.g., SecAlign, StruQ), revealing a fundamental blind spot in the current safety landscape. Data and code are available at https://github.com/Yuan-Hou/criteria_attack.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 24 of its 37 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
24 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
- 2020Measuring Association Between Labels and Free-Text Rationalescited by 160
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judgecited by 143
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 126
- 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMscited by 95
- 2025Safety in Large Reasoning Models: A Surveycited by 64
11 more
- 2018Challenges for Toxic Comment Classification: An In-Depth Error Analysiscited by 56
- 2025A Mousetrap: Fooling Large Reasoning Models for Jailbreak with Chain of Iterative Chaoscited by 43
- 2025Defending Against Prompt Injection With a Few DefensiveTokenscited by 33
- 2020Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?cited by 30
- 2025ShadowCoT: Cognitive Hijacking for Stealthy Reasoning Backdoors in LLMscited by 30
- 2025TopicAttack: An Indirect Prompt Injection Attack via Topic Transitioncited by 17
- 2024Efficient Universal Goal Hijacking with Semantics-guided Prompt Organizationcited by 16
- 2025Manipulating LLM Web Agents with Indirect Prompt Injection Attack via HTML Accessibility Treecited by 14
- 2025Attention is All You Need to Defend Against Indirect Prompt Injection Attacks in LLMscited by 10
- 2025Prompt-in-Content Attacks: Exploiting Uploaded Inputs to Hijack LLM Behaviorcited by 3
- 2025Separator Injection Attack: Uncovering Dialogue Biases in Large Language Models Caused by Role Separatorscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026On the Efficiency-Safety Dilemma in Large Reasoning Models
- 2026Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models
- 2025Weakest Link in the Chain: Security Vulnerabilities in Advanced Reasoning Models
- 2025AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models
- 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
- 2025HauntAttack: When Attack Follows Reasoning as a Shadow
- 2025Semantic Representation Attack against Aligned Large Language Models
- 2025Turning Logic Against Itself : Probing Model Defenses Through Contrastive Questions