Beyond the Node: Clade-level Selection for Efficient MCTS in Automatic Heuristic Design
Not on the map. Why?
Abstract (arXiv)
While Monte Carlo Tree Search (MCTS) shows promise in Large Language Model (LLM) based Automatic Heuristic Design (AHD), it suffers from a critical over-exploitation tendency under the limited computational budgets required for heuristic evaluation. To address this limitation, we propose Clade-AHD, an efficient framework that replaces node-level point estimates with clade-level Bayesian beliefs. By aggregating descendant evaluations into Beta distributions and performing Thompson Sampling over these beliefs, Clade-AHD explicitly models uncertainty to guide exploration, enabling more reliable decision-making under sparse and noisy evaluations. Extensive experiments on complex combinatorial optimization problems demonstrate that Clade-AHD consistently outperforms state-of-the-art methods while significantly reducing computational cost. The source code is publicly available at: https://github.com/Mriya0306/Clade-AHD.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 48 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
23 of 48 references.
References · 23
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2015Pointer Networkscited by 882
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2017A Tutorial on Thompson Samplingcited by 420
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
- 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 92
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
11 more
- 2023Large Language Models for Supply Chain Optimizationcited by 61
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2025Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Searchcited by 48
- 2022Reinforced Genetic Algorithm for Structure-based Drug Designcited by 46
- 2024LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generationcited by 45
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 44
- 2023Distributed Constrained Combinatorial Optimization leveraging Hypergraph Neural Networkscited by 13
- 2024Leveraging Large Language Model to Generate a Novel Metaheuristic Algorithm with CRISPE Frameworkcited by 8
- 2023Efficient Evaluation Methods for Neural Architecture Search: A Surveycited by 7
- 2025Timing-Driven Global Placement by Efficient Critical Path Extractioncited by 4
- 2021Reducing Waiting Times at Charging Stations with Adaptive Electric Vehicle Route Planningcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.