mlsanityData to 7 Oct 2026

Consistency of Large Reasoning Models Under Multi-Turn Attacks

arXiv 2602.13093 ↗First posted 13 Feb 2026cs.AI cs.CLcited by 4

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Large reasoning models with reasoning capabilities achieve state-of-the-art performance on complex tasks, but their robustness under multi-turn adversarial pressure remains underexplored. We evaluate nine frontier reasoning models under adversarial attacks. Our findings reveal that reasoning confers meaningful but incomplete robustness: most reasoning models studied significantly outperform instruction-tuned baselines, yet all exhibit distinct vulnerability profiles, with misleading suggestions universally effective and social pressure showing model-specific efficacy. Through trajectory analysis, we identify five failure modes (Self-Doubt, Social Conformity, Suggestion Hijacking, Emotional Susceptibility, and Reasoning Fatigue) with the first two accounting for 50% of failures. We further demonstrate that Confidence-Aware Response Generation (CARG), effective for standard LLMs, fails for reasoning models due to overconfidence induced by extended reasoning traces; counterintuitively, random confidence embedding outperforms targeted extraction. Our results highlight that reasoning capabilities do not automatically confer adversarial robustness and that confidence-based defenses require fundamental redesign for reasoning models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 22 of its 41 references that are in the map. First posted on arXiv 13 Feb 2026.

Builds on

22 of 41 references.

References · 22

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  5. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  6. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  7. 2018Scalable agent alignment via reward modeling: a research directioncited by 438
  8. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
  9. 2018AI safety via debatecited by 384
  10. 2022Self-critiquing models for assisting human evaluatorscited by 372
  11. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 293
  12. 2022Measuring Progress on Scalable Oversight for Large Language Modelscited by 212
10 more
  1. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  2. 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
  3. 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 136
  4. 2024Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Followingcited by 94
  5. 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
  6. 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 78
  7. 2023Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experimentcited by 71
  8. 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Modelscited by 58
  9. 2025Time-To-Inconsistency: A Survival Analysis of Large Language Model Robustness to Adversarial Attackscited by 6
  10. 2024Mitigating Sycophancy in Decoder-Only Transformer Architectures: Synthetic Data Interventioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026On the Efficiency-Safety Dilemma in Large Reasoning Models
  2. 2026Assessing Adversarial Robustness of Latent Reasoning Models
  3. 2025AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models
  4. 2025Does More Inference-Time Compute Really Help Robustness?
  5. 2025Cats Confuse Reasoning LLM: Query Agnostic Adversarial Triggers for Reasoning Models
  6. 2025Weakest Link in the Chain: Security Vulnerabilities in Advanced Reasoning Models
  7. 2025Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense
  8. 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probing