Latent Chain-of-Thought as Planning: Decoupling Reasoning from Verbalization
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Chain-of-Thought (CoT) empowers Large Language Models (LLMs) to tackle complex problems, but remains constrained by the computational cost and early token commitments in discrete reasoning traces. Recent latent reasoning approaches attempt to optimize efficiency by performing reasoning within continuous hidden states. However, many such methods optimize latent states end to end without a trained interface for intermediate textual readout, and several representative configurations use a pre-defined number of latent steps during inference. In this work, we introduce PLaT (Planning with Latent Thoughts), a framework that decouples latent planning from verbalization. The Planner deterministically evolves latent planning states, while an independent Decoder provides textual readouts when needed. Answer-aware textual stopping allows the latent rollout to use a problem-dependent number of groups rather than a pre-specified chain length. PLaT achieves competitive coverage at larger k in several mathematical settings, with lower Pass@1: on Llama-1B GSM8K, it reaches 80.59% Pass@128 versus CODI's 72.37%. These results support PLaT as a candidate-generation interface supplying multiple textual readouts for downstream verification or reranking.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 55 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
43 of 55 references.
Closest ancestors · 17
Same direction, newest first
- 2025System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcuts25 May
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning22 May
- 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space21 May
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation28 Feb
- 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs17 Feb
- 2024Training Large Language Models to Reason in a Continuous Latent Space9 Dec
- 2023Implicit Chain of Thought Reasoning via Knowledge Distillation2 Nov
- 2023Guiding Language Model Reasoning with Planning Tokens9 Oct
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Models18 Aug
- 2023Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models26 May
- 2023Faithful Chain-of-Thought Reasoning31 Jan
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks22 Nov
5 more
- 2022Automatic Chain of Thought Prompting in Large Language Models7 Oct
- 2022Large Language Models are Zero-Shot Reasoners24 May
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan
Other references · 26
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2023Large Language Models as Optimizerscited by 864
- 2022PAL: Program-aided Language Modelscited by 652
14 more
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
- 2016Solving General Arithmetic Word Problemscited by 360
- 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
- 2018Blockwise Parallel Decoding for Deep Autoregressive Modelscited by 323
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 264
- 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
- 2023Large Language Model Guided Tree-of-Thoughtcited by 221
- 2023Structured Chain-of-Thought Prompting for Code Generationcited by 138
- 2025Efficient Reasoning Models: A Surveycited by 95
- 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 85
- 2025Your LLM Knows the Future: Uncovering Its Multi-Token Prediction Potentialcited by 47
- 2025Roll the dice & look before you leap: Going beyond the creative limits of next-token predictioncited by 29
- 2023Tree of Uncertain Thoughts Reasoning for Large Language Modelscited by 19
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 43
- 2026Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformerscited by 13
- 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoningcited by 3
- 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoningcited by 2
- 2026Artificial Agency Program: Curiosity, compression, and communication in agentscited by 1
- 2026Plan Canvas: Fixed Reasoning Regions for Continuous Language Flowscited by 0
- 2026Plan Canvas: Fixed Reasoning Regions for Continuous Language Flows5 Oct 2026
- 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoning10 Aug 2026
- 2026Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers30 Jun 2026
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlook2 Apr 2026
- 2026Artificial Agency Program: Curiosity, compression, and communication in agents27 Feb 2026
- 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning
- 2025A Formal Comparison Between Chain of Thought and Latent Thought
- 2026The Depth Ceiling: On the Limits of Large Language Models in Discovering Latent Planning
- 2025Enhancing Long Chain-of-Thought Reasoning through Multi-Path Plan Aggregation
- 2026Thinking Without Words: Efficient Latent Reasoning with Abstract Chain-of-Thought
- 2025Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics
- 2026Emergent Search and Backtracking in Latent Reasoning Models
- 2026Latent Reasoning with Supervised Thinking States