mlsanityData to 7 Oct 2026

RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional Experience

arXiv 2607.11358 ↗First posted 13 Jul 2026cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Automatic Heuristic Design (AHD) has emerged as a transformative approach for solving combinatorial optimization problems. While recent Large Language Model (LLM)-based methods have shown promise, they predominantly rely on fixed evolutionary operators and struggle to effectively accumulate and reuse historical search experience. This paper proposes RefineEvo, a novel evolutionary framework that transforms AHD from a static trial-and-error process into a planning-guided, experience-driven system. RefineEvo introduces a Planner to dynamically schedule evolutionary operators and trigger refinement based on the current search state, and a Reflector to distill valuable lessons into a Bidirectional Experience Pool containing both positive insights and negative pitfalls. This synergistic framework enables the system to adapt its search tools to the evolving complexity of the problem and leverage trajectory-aware, situation-conditioned insights to guide generation. Experiments on several classic combinatorial optimization benchmarks demonstrate that RefineEvo consistently outperforms strong baselines. In particular, RefineEvo delivers superior solution quality while improving token efficiency, enabling more efficient and autonomous heuristic design.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 50 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

26 of 50 references.

References · 26

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  5. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  6. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  7. 2018Attention, Learn to Solve Routing Problems!cited by 646
  8. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  9. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
  10. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  11. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
  12. 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 102
14 more
  1. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
  2. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 95
  3. 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
  4. 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
  5. 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
  6. 2023CodeScore: Evaluating Code Generation by Learning Code Executioncited by 66
  7. 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 65
  8. 2025Training-Free Group Relative Policy Optimizationcited by 53
  9. 2025CALM: Co-evolution of Algorithms and Language Model for Automatic Heuristic Designcited by 28
  10. 2025HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challengescited by 19
  11. 2025HiFo-Prompt: Prompting with Hindsight and Foresight for LLM-based Automatic Heuristic Designcited by 13
  12. 2025Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimizationcited by 4
  13. 2025Experience-Guided Reflective Co-Evolution of Prompts and Heuristics for Automatic Algorithm Designcited by 4
  14. 2014An Experimental Study of Adaptive Control for Evolutionary Algorithmscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.