mlsanityData to 14 Oct 2026

AutoEP: LLMs-Driven Automation of Hyperparameter Evolution for Metaheuristic Algorithms

arXiv 2509.23189 ↗First posted 27 Sep 2025cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Dynamically configuring algorithm hyperparameters is a fundamental challenge in computational intelligence. While learning-based methods offer automation, they suffer from prohibitive sample complexity and poor generalization. We introduce AutoEP, a novel framework that bypasses training entirely by leveraging Large Language Models (LLMs) as zero-shot reasoning engines for algorithm control. AutoEP's core innovation lies in a tight synergy between two components: (1) an online Exploratory Landscape Analysis (ELA) module that provides real-time, quantitative feedback on the search dynamics, and (2) a multi-LLM reasoning chain that interprets this feedback to generate adaptive hyperparameter strategies. This approach grounds high-level reasoning in empirical data, mitigating hallucination. Evaluated on three distinct metaheuristics across diverse combinatorial optimization benchmarks, AutoEP consistently outperforms state-of-the-art tuners, including neural evolution and other LLM-based methods. Notably, our framework enables open-source models like Qwen3-30B to match the performance of GPT-4, demonstrating a powerful and accessible new paradigm for automated hyperparameter design. Our code is available at https://github.com/YiZheZhang12/AutoEP.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 53 references that are in the map. First posted on arXiv 27 Sep 2025.

Builds on

21 of 53 references.

References · 21

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  3. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
  4. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
  5. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
  6. 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
  7. 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 90
  8. 2024Large Language Models As Evolution Strategiescited by 58
  9. 2025Algorithm Discovery With LLMs: Evolutionary Search Meets Reinforcement Learningcited by 46
  10. 2023MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learningcited by 36
  11. 2020Time Efficiency in Optimization with a Bayesian-Evolutionary Algorithmcited by 27
  12. 2024Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolutioncited by 24
9 more
  1. 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 24
  2. 2024Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learningcited by 17
  3. 2023B2Opt: Learning to Optimize Black-box Optimization with Little Budgetcited by 15
  4. 2024ConfigX: Modular Configuration for Evolutionary Algorithms via Multitask Reinforcement Learningcited by 15
  5. 2024Neural Exploratory Landscape Analysis for Meta-Black-Box-Optimizationcited by 10
  6. 2022Reinforcement learning based adaptive metaheuristicscited by 7
  7. 2025Fine-tuning Large Language Model for Automated Algorithm Designcited by 6
  8. 2025Accurate Peak Detection in Multimodal Optimization via Approximated Landscape Learningcited by 5
  9. 2025DesignX: Human-Competitive Algorithm Designer for Black-Box Optimizationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024An investigation on the use of Large Language Models for hyperparameter tuning in Evolutionary Algorithms
  2. 2026Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch
  3. 2024Large Language Model Agent for Hyper-Parameter Optimization
  4. 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
  5. 2026Hyper-ES: Effective Evolution Strategies for LLM Reasoning via Descent Direction Merging
  6. 2026EPOCH: Coverage-Aware Evolution with Experiential Preference Optimization for LLM-based Automated Heuristic Design
  7. 2026MAXS: Meta-Adaptive Exploration with LLM Agents
  8. 2026Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO