Consistency of Large Reasoning Models Under Multi-Turn Attacks
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large reasoning models with reasoning capabilities achieve state-of-the-art performance on complex tasks, but their robustness under multi-turn adversarial pressure remains underexplored. We evaluate nine frontier reasoning models under adversarial attacks. Our findings reveal that reasoning confers meaningful but incomplete robustness: most reasoning models studied significantly outperform instruction-tuned baselines, yet all exhibit distinct vulnerability profiles, with misleading suggestions universally effective and social pressure showing model-specific efficacy. Through trajectory analysis, we identify five failure modes (Self-Doubt, Social Conformity, Suggestion Hijacking, Emotional Susceptibility, and Reasoning Fatigue) with the first two accounting for 50% of failures. We further demonstrate that Confidence-Aware Response Generation (CARG), effective for standard LLMs, fails for reasoning models due to overconfidence induced by extended reasoning traces; counterintuitively, random confidence embedding outperforms targeted extraction. Our results highlight that reasoning capabilities do not automatically confer adversarial robustness and that confidence-based defenses require fundamental redesign for reasoning models.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 22 of its 41 references that are in the map. First posted on arXiv 13 Feb 2026.
Builds on
22 of 41 references.
References · 22
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2018Scalable agent alignment via reward modeling: a research directioncited by 438
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2018AI safety via debatecited by 384
- 2022Self-critiquing models for assisting human evaluatorscited by 372
- 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 293
- 2022Measuring Progress on Scalable Oversight for Large Language Modelscited by 212
10 more
- 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 136
- 2024Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Followingcited by 94
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
- 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 78
- 2023Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experimentcited by 71
- 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Modelscited by 58
- 2025Time-To-Inconsistency: A Survival Analysis of Large Language Model Robustness to Adversarial Attackscited by 6
- 2024Mitigating Sycophancy in Decoder-Only Transformer Architectures: Synthetic Data Interventioncited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026On the effectiveness of reward functions in reinforcement learning for confidence calibration of large language modelscited by 2
- 2026Who Flips? Self- and Cross-Model Counterarguments Reveal Answer Instability in LLMscited by 1
- 2026SKG-Eval: Stateful Evaluation of Multi-Turn Dialogue via Incremental Semantic Knowledge Graphscited by 0
- 2026Measuring LLM Sycophancy under Sustained Multi-Turn Pressurecited by 0
- 2026Measuring LLM Sycophancy under Sustained Multi-Turn Pressure8 Sep 2026
- 2026On the effectiveness of reward functions in reinforcement learning for confidence calibration of large language models5 Jul 2026
- 2026Who Flips? Self- and Cross-Model Counterarguments Reveal Answer Instability in LLMs14 Jun 2026
- 2026SKG-Eval: Stateful Evaluation of Multi-Turn Dialogue via Incremental Semantic Knowledge Graphs15 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026On the Efficiency-Safety Dilemma in Large Reasoning Models
- 2026Assessing Adversarial Robustness of Latent Reasoning Models
- 2025AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models
- 2025Does More Inference-Time Compute Really Help Robustness?
- 2025Cats Confuse Reasoning LLM: Query Agnostic Adversarial Triggers for Reasoning Models
- 2025Weakest Link in the Chain: Security Vulnerabilities in Advanced Reasoning Models
- 2025Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense
- 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probing