AutoEP: LLMs-Driven Automation of Hyperparameter Evolution for Metaheuristic Algorithms
Not on the map. Why?
Abstract (arXiv)
Dynamically configuring algorithm hyperparameters is a fundamental challenge in computational intelligence. While learning-based methods offer automation, they suffer from prohibitive sample complexity and poor generalization. We introduce AutoEP, a novel framework that bypasses training entirely by leveraging Large Language Models (LLMs) as zero-shot reasoning engines for algorithm control. AutoEP's core innovation lies in a tight synergy between two components: (1) an online Exploratory Landscape Analysis (ELA) module that provides real-time, quantitative feedback on the search dynamics, and (2) a multi-LLM reasoning chain that interprets this feedback to generate adaptive hyperparameter strategies. This approach grounds high-level reasoning in empirical data, mitigating hallucination. Evaluated on three distinct metaheuristics across diverse combinatorial optimization benchmarks, AutoEP consistently outperforms state-of-the-art tuners, including neural evolution and other LLM-based methods. Notably, our framework enables open-source models like Qwen3-30B to match the performance of GPT-4, demonstrating a powerful and accessible new paradigm for automated hyperparameter design. Our code is available at https://github.com/YiZheZhang12/AutoEP.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 53 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
21 of 53 references.
References · 21
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 90
- 2024Large Language Models As Evolution Strategiescited by 58
- 2025Algorithm Discovery With LLMs: Evolutionary Search Meets Reinforcement Learningcited by 46
- 2023MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learningcited by 36
- 2020Time Efficiency in Optimization with a Bayesian-Evolutionary Algorithmcited by 27
- 2024Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolutioncited by 24
9 more
- 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 24
- 2024Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learningcited by 17
- 2023B2Opt: Learning to Optimize Black-box Optimization with Little Budgetcited by 15
- 2024ConfigX: Modular Configuration for Evolutionary Algorithms via Multitask Reinforcement Learningcited by 15
- 2024Neural Exploratory Landscape Analysis for Meta-Black-Box-Optimizationcited by 10
- 2022Reinforcement learning based adaptive metaheuristicscited by 7
- 2025Fine-tuning Large Language Model for Automated Algorithm Designcited by 6
- 2025Accurate Peak Detection in Multimodal Optimization via Approximated Landscape Learningcited by 5
- 2025DesignX: Human-Competitive Algorithm Designer for Black-Box Optimizationcited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
- 2026TIDE: Tuning-Integrated Dynamic Evolution for LLM-Based Automated Heuristic Designcited by 3
- 2026A Learning-Based Cooperative Coevolution Framework for Heterogeneous Large-Scale Global Optimizationcited by 1
- 2026Agentic MIP Research: Accelerated Constraint Handler Generationcited by 1
- 2026Agentic MIP Research: Accelerated Constraint Handler Generation9 May 2026
- 2026A Learning-Based Cooperative Coevolution Framework for Heterogeneous Large-Scale Global Optimization30 Mar 2026
- 2026Meta Context Engineering via Agentic Skill Evolution29 Jan 2026
- 2026TIDE: Tuning-Integrated Dynamic Evolution for LLM-Based Automated Heuristic Design29 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024An investigation on the use of Large Language Models for hyperparameter tuning in Evolutionary Algorithms
- 2026Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch
- 2024Large Language Model Agent for Hyper-Parameter Optimization
- 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
- 2026Hyper-ES: Effective Evolution Strategies for LLM Reasoning via Descent Direction Merging
- 2026EPOCH: Coverage-Aware Evolution with Experiential Preference Optimization for LLM-based Automated Heuristic Design
- 2026MAXS: Meta-Adaptive Exploration with LLM Agents
- 2026Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO