mlsanityData to 14 Oct 2026

Latent Chain-of-Thought as Planning: Decoupling Reasoning from Verbalization

arXiv 2601.21358 ↗First posted 29 Jan 2026cs.AI cs.CLcited by 6

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

Chain-of-Thought (CoT) empowers Large Language Models (LLMs) to tackle complex problems, but remains constrained by the computational cost and early token commitments in discrete reasoning traces. Recent latent reasoning approaches attempt to optimize efficiency by performing reasoning within continuous hidden states. However, many such methods optimize latent states end to end without a trained interface for intermediate textual readout, and several representative configurations use a pre-defined number of latent steps during inference. In this work, we introduce PLaT (Planning with Latent Thoughts), a framework that decouples latent planning from verbalization. The Planner deterministically evolves latent planning states, while an independent Decoder provides textual readouts when needed. Answer-aware textual stopping allows the latent rollout to use a problem-dependent number of groups rather than a pre-specified chain length. PLaT achieves competitive coverage at larger k in several mathematical settings, with lower Pass@1: on Llama-1B GSM8K, it reaches 80.59% Pass@128 versus CODI's 72.37%. These results support PLaT as a candidate-generation interface supplying multiple textual readouts for downstream verification or reranking.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 55 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

43 of 55 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcuts25 May
  2. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning22 May
  3. 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space21 May
  4. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation28 Feb
  5. 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs17 Feb
  6. 2024Training Large Language Models to Reason in a Continuous Latent Space9 Dec
  7. 2023Implicit Chain of Thought Reasoning via Knowledge Distillation2 Nov
  8. 2023Guiding Language Model Reasoning with Planning Tokens9 Oct
  9. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Models18 Aug
  10. 2023Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models26 May
  11. 2023Faithful Chain-of-Thought Reasoning31 Jan
  12. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks22 Nov
5 more
  1. 2022Automatic Chain of Thought Prompting in Large Language Models7 Oct
  2. 2022Large Language Models are Zero-Shot Reasoners24 May
  3. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan

Other references · 26

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  10. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  11. 2023Large Language Models as Optimizerscited by 864
  12. 2022PAL: Program-aided Language Modelscited by 652
14 more
  1. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
  2. 2016Solving General Arithmetic Word Problemscited by 360
  3. 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
  4. 2018Blockwise Parallel Decoding for Deep Autoregressive Modelscited by 323
  5. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  6. 2023Think before you speak: Training Language Models With Pause Tokenscited by 264
  7. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
  8. 2023Large Language Model Guided Tree-of-Thoughtcited by 221
  9. 2023Structured Chain-of-Thought Prompting for Code Generationcited by 138
  10. 2025Efficient Reasoning Models: A Surveycited by 95
  11. 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 85
  12. 2025Your LLM Knows the Future: Uncovering Its Multi-Token Prediction Potentialcited by 47
  13. 2025Roll the dice & look before you leap: Going beyond the creative limits of next-token predictioncited by 29
  14. 2023Tree of Uncertain Thoughts Reasoning for Large Language Modelscited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning
  2. 2025A Formal Comparison Between Chain of Thought and Latent Thought
  3. 2026The Depth Ceiling: On the Limits of Large Language Models in Discovering Latent Planning
  4. 2025Enhancing Long Chain-of-Thought Reasoning through Multi-Path Plan Aggregation
  5. 2026Thinking Without Words: Efficient Latent Reasoning with Abstract Chain-of-Thought
  6. 2025Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics
  7. 2026Emergent Search and Backtracking in Latent Reasoning Models
  8. 2026Latent Reasoning with Supervised Thinking States