CogMCTS: A Novel Cognitive-Guided Monte Carlo Tree Search Framework for Iterative Heuristic Evolution with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Automatic Heuristic Design (AHD) is an effective framework for solving complex optimization problems. The development of large language models (LLMs) enables the automated generation of heuristics. Existing LLM-based evolutionary methods rely on population strategies and are prone to local optima. Integrating LLMs with Monte Carlo Tree Search (MCTS) improves the trade-off between exploration and exploitation, but multi-round cognitive integration remains limited and search diversity is constrained. To overcome these limitations, this paper proposes a novel cognitive-guided MCTS framework (CogMCTS). CogMCTS tightly integrates the cognitive guidance mechanism of LLMs with MCTS to achieve efficient automated heuristic optimization. The framework employs multi-round cognitive feedback to incorporate historical experience, node information, and negative outcomes, dynamically improving heuristic generation. Dual-track node expansion combined with elite heuristic management balances the exploration of diverse heuristics and the exploitation of high-quality experience. In addition, strategic mutation modifies the heuristic forms and parameters to further enhance the diversity of the solution and the overall optimization performance. The experimental results indicate that CogMCTS outperforms existing LLM-based AHD methods in stability, efficiency, and solution quality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 57 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
35 of 57 references.
References · 35
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2023Teaching Large Language Models to Self-Debugcited by 988
- 2015Pointer Networkscited by 895
- 2023Large Language Models as Optimizerscited by 864
- 2023A Comprehensive Overview of Large Language Modelscited by 648
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
23 more
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
- 2022Evolution through Large Modelscited by 134
- 2023EvoPrompting: Language Models for Code-Level Neural Architecture Searchcited by 131
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
- 2023Large Language Models as Evolutionary Optimizerscited by 124
- 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 122
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 109
- 2023Learning Performance-Improving Code Editscited by 106
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 90
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 78
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 73
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 69
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2024Evolving Code with A Large Language Modelcited by 43
- 2023LLMs for Science: Usage for Code Generation and Data Analysiscited by 34
- 2023Fully Autonomous Programming with Large Language Modelscited by 31
- 2022How Good Is Neural Combinatorial Optimization? A Systematic Evaluation on the Traveling Salesman Problemcited by 27
- 2024Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithmscited by 26
- 2024Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classroomscited by 20
- 2025Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimizationcited by 14
- 2023Automated Design of Metaheuristic Algorithms: A Surveycited by 12
Built on by
Not cited yet.