iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models (LLMs), when guided by explicit textual plans, can perform reliable step-by-step reasoning during problem-solving. However, generating accurate and effective textual plans remains challenging due to LLM hallucinations and the high diversity of task-specific questions. To address this, we draw inspiration from human Implicit Cognition (IC), the subconscious process by which decisions are guided by compact, generalized patterns learned from past experiences without requiring explicit verbalization. We propose iCLP, a novel framework that enables LLMs to adaptively generate latent plans (LPs), which are compact encodings of effective reasoning instructions. iCLP first distills explicit plans from existing step-by-step reasoning trajectories. It then learns discrete representations of these plans via a vector-quantized autoencoder coupled with a codebook. Finally, by fine-tuning LLMs on paired latent plans and corresponding reasoning steps, the models learn to perform implicit planning during reasoning. Experimental results on mathematical reasoning and code generation tasks demonstrate that, with iCLP, LLMs can plan in latent space while reasoning in language space. This approach yields significant improvements in both accuracy and efficiency and, crucially, demonstrates strong cross-domain generalization while preserving the interpretability of chain-of-thought reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 39 of its 46 references that are in the map. First posted on arXiv 30 Dec 2025.
Builds on
39 of 46 references.
Closest ancestors · 2
Same direction, newest first
- 2023Deductive Verification of Chain-of-Thought Reasoning6 Jun
- 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct
Other references · 37
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
25 more
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2024Understanding the planning of LLM agents: A surveycited by 414
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
- 2023In-context Autoencoder for Context Compression in a Large Language Modelcited by 190
- 2023SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoningcited by 157
- 2024Byte Latent Transformer: Patches Scale Better Than Tokenscited by 137
- 2024LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBenchcited by 93
- 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoningcited by 87
- 2024Large Concept Models: Language Modeling in a Sentence Representation Spacecited by 86
- 2023On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)cited by 85
- 2024AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planningcited by 81
- 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agentscited by 61
- 2024Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizingcited by 49
- 2025LLM Pretraining with Continuous Conceptscited by 33
- 2024Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Modelscited by 22
- 2024Revealing the Barriers of Language Agents in Planningcited by 20
- 2024Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generationcited by 15
- 2024Toward Adaptive Reasoning in Large Language Models with Thought Rollbackcited by 11
- 2023LaRS: Latent Reasoning Skills for Chain-of-Thought Reasoningcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026LLM Reasoning Is Latent, Not the Chain of Thoughtcited by 0
- 2026LLM Reasoning Is Latent, Not the Chain of Thought17 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Implicit Reasoning in Large Language Models: A Comprehensive Survey
- 2025Advancing Reasoning in Large Language Models: Promising Methods and Approaches
- 2025Implicit Reasoning in Transformers is Reasoning through Shortcuts
- 2026Opening the Black Box: A Survey on the Mechanisms of Multi-Step Reasoning in Large Language Models
- 2025Beyond Words: A Latent Memory Approach to Internal Reasoning in LLMs
- 2023Explicit Planning Helps Language Models in Logical Reasoning
- 2025CRISP: Complex Reasoning with Interpretable Step-based Plans
- 2026PILOT: Planning via Internalized Latent Optimization Trajectories for Large Language Models