Assessing Adversarial Robustness of Latent Reasoning Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models increasingly rely on long chain-of-thought (CoT) trajectories for complex reasoning, but autoregressive generation brings substantial memory and inference costs. Latent reasoning models (LRMs) offer a more efficient alternative by compressing intermediate reasoning into a small number of continuous latent vectors. Despite their efficiency, however, the adversarial robustness of LRMs remains largely underexplored. In this work, we systematically evaluate the robustness of latent reasoning across textual and multimodal settings, covering eight models and six benchmarks. We find that, across our evaluated settings, LRMs are generally less robust than explicit CoT baselines under adversarial perturbations, with particularly severe degradation under white-box attacks. Further analysis reveals distinct failure modes across modalities: textual latent states exhibit brittle dynamics and high sensitivity to specific input patterns, while latent states in multimodal models can remain largely invariant to input perturbations and have limited influence on final predictions. These findings expose robustness limitations of current latent reasoning approaches and highlight the need to jointly consider efficiency and robustness when designing implicit reasoning systems. We have open-sourced our code to facilitate reproduction of our research https://github.com/PKU-ML/latent-reasoning-model-assessment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 35 of its 44 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
35 of 44 references.
Closest ancestors · 3
Same direction, newest first
- 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains22 May
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?31 Mar
- 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
Other references · 32
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
20 more
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2016Solving General Arithmetic Word Problemscited by 360
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 284
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2024GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solverscited by 158
- 2025Latent Visual Reasoningcited by 104
- 2025Monet: Reasoning in Latent Visual Space Beyond Images and Languagecited by 82
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 78
- 2025SIM-CoT: Supervised Implicit Chain-of-Thoughtcited by 70
- 2024Stop Reasoning! When Multimodal LLM with Chain-of-Thought Reasoning Meets Adversarial Imagecited by 26
- 2025Parallel Continuous Chain-of-Thought with Jacobi Iterationcited by 25
- 2025Sketch-in-Latents: Eliciting Unified Reasoning in MLLMscited by 25
- 2025Do Latent Tokens Think? A Causal and Adversarial Analysis of Chain-of-Continuous-Thoughtcited by 23
- 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoningcited by 20
- 2026VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Modelscited by 14
- 2026Imagination Helps Visual Reasoning, But Not Yet in Latent Spacecited by 12
- 2025Exploring LLM Reasoning Through Controlled Prompt Variationscited by 10
- 2025SECA: Semantically Equivalent and Coherent Attacks for Eliciting LLM Hallucinationscited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey on Latent Reasoning
- 2026Consistency of Large Reasoning Models Under Multi-Turn Attacks
- 2024Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding
- 2025Investigating the Robustness of Deductive Reasoning with Large Language Models
- 2026Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence
- 2026Unlocking the Black Box of Latent Reasoning: An Interpretability-Guided Approach to Intervention
- 2025Thinking on the Fly: Test-Time Reasoning Enhancement via Latent Thought Policy Optimization
- 2026Robust Reasoning Benchmark