Thinking Wrong in Silence: Backdoor Attacks on Continuous Latent Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
A new generation of language models reasons entirely in continuous hidden states, producing no tokens and leaving no audit trail. We show that this silence creates a fundamentally new attack surface. ThoughtSteer perturbs a single embedding vector at the input layer; the model's own multi-pass reasoning amplifies this perturbation into a hijacked latent trajectory that reliably produces the attacker's chosen answer, while remaining structurally invisible to every token-level defense. Across two architectures (Coconut and SimCoT), three reasoning benchmarks, and model scales from 124M to 3B parameters, ThoughtSteer achieves >=99% attack success rate with near-baseline clean accuracy, transfers to held-out benchmarks without retraining (94-100%), evades all five evaluated active defenses, and survives 25 epochs of clean fine-tuning. We trace these results to a unifying mechanism: Neural Collapse in the latent space pulls triggered representations onto a tight geometric attractor, explaining both why defenses fail and why any effective backdoor must leave a linearly separable signature (probe AUC>=0.999). Yet a striking paradox emerges: individual latent vectors still encode the correct answer even as the model outputs the wrong one. The adversarial information is not in any single vector but in the collective trajectory, establishing backdoor perturbations as a new lens for mechanistic interpretability of continuous reasoning. Code and checkpoints are available.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 26 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
20 of 26 references.
Closest ancestors · 2
Same direction, newest first
- 2025Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs9 Oct
- 2025DarkMind: Latent Chain-of-Thought Backdoor in Customized LLMs24 Jan
Other references · 18
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 953
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 719
- 2022PAL: Program-aided Language Modelscited by 652
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 459
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 456
6 more
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2016Solving General Arithmetic Word Problemscited by 360
- 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 337
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
- 2024Linguistic Collapse: Neural Collapse in (Large) Language Modelscited by 38
- 2024Trojan Cleansing with Neural Collapsecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Critical-CoT: A Robust Defense Framework against Reasoning-Level Backdoor Attacks in Large Language Models
- 2026Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller
- 2025One Token Embedding Is Enough to Deadlock Your Large Reasoning Model
- 2025Do Latent Tokens Think? A Causal and Adversarial Analysis of Chain-of-Continuous-Thought
- 2026STAR: Detecting Inference-time Backdoors in LLM Reasoning via State-Transition Amplification Ratio
- 2025BadThink: Triggered Overthinking Attacks on Chain-of-Thought Reasoning in Large Language Models
- 2026Language Triggers Hijack Language Circuits: A Mechanistic Analysis of Backdoor Behaviors in Large Language Models
- 2025BadReasoner: Planting Tunable Overthinking Backdoors into Large Reasoning Models for Fun or Profit