Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Automating operations research (OR) with large language models (LLMs) remains limited by hand-crafted reasoning--execution workflows. Complex OR tasks require adaptive coordination among problem interpretation, mathematical formulation, solver selection, code generation, and iterative debugging. To address this limitation, we propose EvoOR-Agent, a co-evolutionary framework for automated optimization. The framework represents agent workflows as activity-on-edge (AOE)-style networks, making workflow topology, execution dependencies, and alternative reasoning paths explicit. On this representation, the framework maintains an architecture graph and evolves a population of reasoning individuals through graph-mediated path-conditioned recombination, multi-granularity semantic mutation, and elitist population update. A knowledge-base-assisted experience-acquisition module further injects reusable OR practices into initialization and semantic variation. Empirical results on heterogeneous OR benchmarks show that the proposed framework consistently improves over zero-shot LLMs, fixed-pipeline OR agents, and representative evolutionary agent frameworks. Case studies and ablation analyses further indicate that explicit architecture evolution and graph-supported reasoning-trajectory search contribute to both performance improvement and structural interpretability. These results suggest that treating agent architectures and reasoning trajectories as evolvable objects provides an effective route toward adaptive and interpretable automated optimization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 41 of its 98 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
41 of 98 references.
Closest ancestors · 1
Same direction, newest first
Other references · 40
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2016An overview of gradient descent optimization algorithmscited by 1,021
- 2025OpenAI GPT-5 System Cardcited by 910
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
28 more
- 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2022Evolution through Large Modelscited by 131
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 111
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 105
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 92
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
- 2023Large Language Models for Supply Chain Optimizationcited by 61
- 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
- 2025ThetaEvolve: Test-time Learning on Open Problemscited by 52
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
- 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
- 2023Challenges and Opportunities in Quantum Optimizationcited by 42
- 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scalecited by 37
- 2024Recent Advances in Generative AI and Large Language Models: Current Status, Challenges, and Perspectivescited by 30
- 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
- 2024Meta Reasoning for Large Language Modelscited by 29
- 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 26
- 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
- 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 23
- 2025OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modelingcited by 23
- 2026DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolutioncited by 23
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows
- 2025MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programming
- 2025Evolving Excellence: Automated Optimization of LLM-based Agents
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Fly
- 2026AlgoEvo: Self-Evolving Agentic Search for Automated Algorithm Discovery
- 2026PathWise: Planning through World Model for Automated Heuristic Design via Self-Evolving LLMs
- 2025Polymath: A Self-Optimizing Agent with Dynamic Hierarchical Workflow
- 2026HyEvo: Self-Evolving Hybrid Agentic Workflows for Efficient Reasoning