mlsanityData to 14 Oct 2026

LLM Reasoning Is Latent, Not the Chain of Thought

arXiv 2604.15726 ↗First posted 17 Apr 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

This position paper argues that large language model (LLM) reasoning should be studied as latent-state trajectory formation rather than as faithful surface chain-of-thought (CoT). This matters because claims about faithfulness, interpretability, reasoning benchmarks, and inference-time intervention all depend on what the field takes the primary object of reasoning to be. We ask what that object should be once three often-confounded factors are separated and formalize three competing hypotheses: H1, reasoning is primarily mediated by latent-state trajectories; H2, reasoning is primarily mediated by explicit surface CoT; and H0, most apparent reasoning gains are better explained by generic serial compute than by any privileged representational object. Reorganizing recent empirical, mechanistic, and survey work under this framework, and adding compute-audited worked exemplars that factorize surface traces, latent interventions, and matched budget expansions, we find that current evidence most strongly supports H1 as a default working hypothesis rather than as a task-independent verdict. We therefore make two recommendations: the field should treat latent-state dynamics as the default object of study for LLM reasoning, and it should evaluate reasoning with designs that explicitly disentangle surface traces, latent states, and serial compute.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 52 of its 59 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

52 of 59 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Interpreting and Controlling LLM Reasoning through Integrated Policy Gradient2 Feb
  2. 2026Exploring the Meta-level Reasoning of Large Language Models via a Tool-based Multi-hop Tabular Question Answering Task12 Jan
  3. 2025iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning30 Dec
  4. 2025Qwen3 Technical Report14 May
  5. 2025Are DeepSeek R1 And Other Reasoning Models More Faithful?14 Jan
  6. 2023Question Decomposition Improves the Faithfulness of Model-Generated Reasoning17 Jul
  7. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning20 May
  8. 2022Faithful Reasoning Using Large Language Models30 Aug

Other references · 44

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  8. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  9. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  10. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  11. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
  12. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
32 more
  1. 2023Faithful Chain-of-Thought Reasoningcited by 288
  2. 2024Chain of Thought Empowers Transformers to Solve Inherently Serial Problemscited by 260
  3. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
  4. 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 191
  5. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 170
  6. 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 169
  7. 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verificationcited by 159
  8. 2025When Chain of Thought is Necessary, Language Models Struggle to Evade Monitorscited by 88
  9. 2025A Survey on Latent Reasoningcited by 81
  10. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 78
  11. 2025Do Large Language Model Benchmarks Test Reliability?cited by 54
  12. 2024Monitoring Latent World States in Language Models with Propositional Probescited by 43
  13. 2025When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoningcited by 42
  14. 2026Reasoning Theater: Disentangling Model Beliefs from Chain-of-Thoughtcited by 40
  15. 2025Position: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces!cited by 37
  16. 2024Iteration Head: A Mechanistic Study of Chain-of-Thoughtcited by 31
  17. 2025Measuring the Faithfulness of Thinking Drafts in Large Reasoning Modelscited by 23
  18. 2025Is Chain-of-Thought Really Not Explainability? Chain-of-Thought Can Be Faithful without Hint Verbalizationcited by 16
  19. 2026Reasoning in Trees: Improving Retrieval-Augmented Generation for Multi-Hop Question Answeringcited by 14
  20. 2026Triggering Chain-of-Thought via Latent Feature Interventions in Large Language Modelscited by 11
  21. 2026Mechanistic Evidence for Faithfulness Decay in Chain-of-Thought Reasoningcited by 9
  22. 2024FLARE: Faithful Logic-Aided Reasoning and Explorationcited by 7
  23. 2025MIRAGE: Scaling Test-Time Inference with Parallel Graph-Retrieval-Augmented Reasoning Chainscited by 7
  24. 2026ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoningcited by 6
  25. 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failurescited by 6
  26. 2026GeoSteer: Faithful Chain-of-Thought Steering via Latent Manifold Gradientscited by 4
  27. 2024Zero-Shot Multi-Hop Question Answering via Monte-Carlo Tree Search with Large Language Modelscited by 3
  28. 2025Towards Inference-time Scaling for Continuous Space Reasoningcited by 2
  29. 2026PAR2-RAG: Planned Active Retrieval and Reasoning for Multi-Hop Question Answeringcited by 2
  30. 2025ReLoop: "Seeing Twice and Thinking Backwards" via Closed-loop Training to Mitigate Hallucinations in Multimodal understandingcited by 1
  31. 2025PathoHR: Hierarchical Reasoning for Vision-Language Models in Pathologycited by 1
  32. 2026Chain of Simulation: A Dual-Mode Reasoning Framework for Large Language Models with Dynamic Problem Routingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
  2. 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning
  3. 2026State of Thought Enables Endogenous Reasoning
  4. 2025Beyond Chains of Thought: Benchmarking Latent-Space Reasoning Abilities in Large Language Models
  5. 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasoners
  6. 2025Position: On the Methodological Pitfalls of Evaluating Base LLMs for Reasoning
  7. 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
  8. 2026PRISM: A Dual View of LLM Reasoning through Semantic Flow and Latent Computation