mlsanityData to 14 Oct 2026

Ulterior Motives: Detecting Misaligned Reasoning in Continuous Thought Models

arXiv 2604.23460 ↗First posted 25 Apr 2026cs.AI cs.CL cs.LGcited by 2

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

also in 1 more
Abstract (arXiv)

Chain-of-Thought (CoT) reasoning has emerged as a key technique for eliciting complex reasoning in Large Language Models (LLMs). Although interpretable, its dependence on natural language limits the model's expressive bandwidth. Continuous thought models address this bottleneck by reasoning in latent space rather than human-readable tokens. While they enable richer representations and faster inference, they raise a critical safety question: how can we detect misaligned reasoning in an uninterpretable latent space? To study this, we introduce MoralChain, a benchmark of 12,000 social scenarios with parallel moral/immoral reasoning paths. We train a continuous thought model with backdoor behavior using a novel dual-trigger paradigm - one trigger that arms misaligned latent reasoning ([T]) and another that releases harmful outputs ([O]). We demonstrate three findings: (1) continuous thought models can exhibit misaligned latent reasoning while producing aligned outputs, with aligned and misaligned reasoning occupying geometrically distinct regions of latent space; (2) linear probes trained on behaviorally-distinguishable conditions ([T][O] vs [O]) transfer to detecting armed-but-benign states ([T] vs baseline) with high accuracy; and (3) misalignment is encoded in early latent thinking tokens, suggesting safety monitoring for continuous thought models should target the "planning" phase of latent reasoning.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 25 references that are in the map. First posted on arXiv 25 Apr 2026.

Builds on

22 of 25 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety15 Jul
  2. 2025Reasoning Models Don't Always Say What They Think8 May
  3. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation28 Feb
  4. 2024Training Large Language Models to Reason in a Continuous Latent Space9 Dec
  5. 2023Measuring Faithfulness in Chain-of-Thought Reasoning17 Jul
  6. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting7 May
  7. 2022Large Language Models are Zero-Shot Reasoners24 May
  8. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan

Other references · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  5. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  6. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  7. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  8. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  9. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
  10. 2024Alignment faking in large language modelscited by 360
  11. 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 337
  12. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
2 more
  1. 2024Frontier Models are Capable of In-context Schemingcited by 287
  2. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 135

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Do Latent Tokens Think? A Causal and Adversarial Analysis of Chain-of-Continuous-Thought
  2. 2025Chain-of-Thought as a Lens: Evaluating Structured Reasoning Alignment between Human Preferences and Large Language Models
  3. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
  4. 2025Thought Crime: Backdoors and Emergent Misalignment in Reasoning Models
  5. 2026A Geometric Perspective on Stabilizing Value Conflict Resolution
  6. 2025A Formal Comparison Between Chain of Thought and Latent Thought
  7. 2025Cognition-of-Thought Elicits Social-Aligned Reasoning in Large Language Models
  8. 2026Reasoning-Token Spikes Under Prompted Untruthful Responding in Large Language Models