Beyond Average Performance: Dynamic Instance Clustering and Specialized Algorithm Design in LLM-Assisted Evolutionary Search
Not on the map. Why?
Abstract (arXiv)
Large Language Model-assisted Evolutionary Search (LES) has emerged as a powerful paradigm for automated algorithm design. However, existing LES methods primarily optimize for average performance, inherently directing search effort toward instances that contribute most to this metric while leaving others poorly served, resulting in weak tail robustness and limited real-world reliability. To address this limitation, we propose Dynamic Instance Clustering and Specialized Algorithm Design (DyCA), an LES framework with a feature-free, structure-aware mechanism for constructing reliable algorithm portfolios under heterogeneous instance distributions. DyCA treats instance clustering as a co-evolving component within the search process, reusing accumulated evaluation data as feature-free signals to progressively partition instances with similar algorithmic response patterns. The uncovered clusters decompose the mixed objective into a set of structure-aware sub-objectives, thereby enabling finer-grained and more adaptive guidance for specialized algorithm design. Experimental results across four algorithm design tasks with heterogeneous instances demonstrate that DyCA outperforms state-of-the-art LES baselines, improving tail robustness by an average of 15.2% and overall performance by 7.1% while maintaining competitive head performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 51 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
19 of 51 references.
References · 19
- 2024Automated Design of Agentic Systemscited by 360
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
- 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 92
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 65
- 2023Algorithm Evolution Using Large Language Modelcited by 52
- 2024Multi-objective Evolution of Heuristic Using Large Language Modelcited by 52
- 2024LLM4AD: A Platform for Algorithm Design with Large Language Modelcited by 33
- 2025EoH-S: Evolution of Heuristic Set using LLMs for Automated Heuristic Designcited by 32
7 more
- 2024Design Principle Transfer in Neural Architecture Search via Large Language Modelscited by 14
- 2018Automatic Construction of Parallel Portfolios via Explicit Instance Groupingcited by 11
- 2025LLM-Driven Instance-Specific Heuristic Generation and Selectioncited by 11
- 2025Multimodal LLM-assisted Evolutionary Search for Programmatic Control Policiescited by 8
- 2024AutoSGNN: Automatic Propagation Mechanism Discovery for Spectral Graph Neural Networkscited by 5
- 2025Discovering Heuristics with Large Language Models (LLMs) for Mixed-Integer Programs: Single-Machine Schedulingcited by 4
- 2020Solving The Lunar Lander Problem under Uncertainty using Reinforcement Learningcited by 3
Built on by
Not cited yet.