mlsanityData to 7 Oct 2026

Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization

arXiv 2604.17708 ↗First posted 20 Apr 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Automating operations research (OR) with large language models (LLMs) remains limited by hand-crafted reasoning--execution workflows. Complex OR tasks require adaptive coordination among problem interpretation, mathematical formulation, solver selection, code generation, and iterative debugging. To address this limitation, we propose EvoOR-Agent, a co-evolutionary framework for automated optimization. The framework represents agent workflows as activity-on-edge (AOE)-style networks, making workflow topology, execution dependencies, and alternative reasoning paths explicit. On this representation, the framework maintains an architecture graph and evolves a population of reasoning individuals through graph-mediated path-conditioned recombination, multi-granularity semantic mutation, and elitist population update. A knowledge-base-assisted experience-acquisition module further injects reusable OR practices into initialization and semantic variation. Empirical results on heterogeneous OR benchmarks show that the proposed framework consistently improves over zero-shot LLMs, fixed-pipeline OR agents, and representative evolutionary agent frameworks. Case studies and ablation analyses further indicate that explicit architecture evolution and graph-supported reasoning-trajectory search contribute to both performance improvement and structural interpretability. These results suggest that treating agent architectures and reasoning trajectories as evolvable objects provides an effective route toward adaptive and interpretable automated optimization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 41 of its 98 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

41 of 98 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review28 Apr

Other references · 40

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2016An overview of gradient descent optimization algorithmscited by 1,021
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  10. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  11. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  12. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
28 more
  1. 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
  2. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
  3. 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
  4. 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
  5. 2022Evolution through Large Modelscited by 131
  6. 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
  7. 2018Automated Algorithm Selection: Survey and Perspectivescited by 111
  8. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
  9. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 105
  10. 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
  11. 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 92
  12. 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
  13. 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
  14. 2023Large Language Models for Supply Chain Optimizationcited by 61
  15. 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
  16. 2025ThetaEvolve: Test-time Learning on Open Problemscited by 52
  17. 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
  18. 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
  19. 2023Challenges and Opportunities in Quantum Optimizationcited by 42
  20. 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scalecited by 37
  21. 2024Recent Advances in Generative AI and Large Language Models: Current Status, Challenges, and Perspectivescited by 30
  22. 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
  23. 2024Meta Reasoning for Large Language Modelscited by 29
  24. 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 26
  25. 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
  26. 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 23
  27. 2025OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modelingcited by 23
  28. 2026DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolutioncited by 23

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows
  2. 2025MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programming
  3. 2025Evolving Excellence: Automated Optimization of LLM-based Agents
  4. 2025EvoFlow: Evolving Diverse Agentic Workflows On The Fly
  5. 2026AlgoEvo: Self-Evolving Agentic Search for Automated Algorithm Discovery
  6. 2026PathWise: Planning through World Model for Automated Heuristic Design via Self-Evolving LLMs
  7. 2025Polymath: A Self-Optimizing Agent with Dynamic Hierarchical Workflow
  8. 2026HyEvo: Self-Evolving Hybrid Agentic Workflows for Efficient Reasoning