ADIAS: Automated Design of Interactive Agentic Systems
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Automated agent design improves agent harnesses through iterative revision, evaluation, and feedback summarization. Existing methods are largely candidate-centric: cross-round experience is organized around candidate agents, which leaves the repair progress implicit. This causes inefficient repair targeting, slow consolidation of partial progress, and propagation of ineffective interventions across rounds. Therefore, we formulate issue-centric agent optimization, in which repair progress is carried forward as an explicit persistent issue state to guide optimization, rather than re-derived from candidate history in each round. We instantiate the formulation in ADIAS, a framework for automated full-code agent design with two mechanisms. A persistent issue state maintains stable issue identities, lifecycle status, supporting evidence, and intervention-outcome histories. Issue-guided optimization uses this state to jointly propose repair targets and revision directions for subsequent focused full-code modification. Across five interactive benchmarks, ADIAS outperforms the strongest baseline by 25.2% on average and achieves consistent gains across four backbone models. Controlled ablations further show that removing persistent issue state or replacing issue-centric revision with candidate-centric policies leads to performance drops of up to 40.7%.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 46 of its 54 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
46 of 54 references.
Closest ancestors · 10
Same direction, newest first
- 2026MemoHarness: Agent Harnesses That Learn from Experience14 Jul
- 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable14 Jul
- 2026Rethinking the Evaluation of Harness Evolution for Agents14 Jul
- 2026TTHE: Test-Time Harness Evolution9 Jul
- 2026Code as Agent Harness18 May
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses28 Apr
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents23 Mar
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine24 Oct
- 2024AFlow: Automating Agentic Workflow Generation14 Oct
- 2024AutoFlow: Automated Workflow Generation for Large Language Model Agents1 Jul
Other references · 36
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023Large Language Models as Optimizerscited by 864
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
24 more
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2024Automated Design of Agentic Systemscited by 407
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 233
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 179
- 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 155
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
- 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 76
- 2024Archon: An Architecture Search Framework for Inference-Time Techniquescited by 60
- 2026Hyperagentscited by 56
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 47
- 2026Position: Agentic Evolution is the Path to Evolving LLMscited by 16
- 2025AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Searchcited by 15
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 13
- 2026Harnessing Agentic Evolutioncited by 11
- 2026GRASP: Gated Regression-Aware Skill Proposer for Self-Improving LLM Agentscited by 11
- 2026Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptationcited by 6
- 2026SKILL.nb: Selective Formalization and Gated Execution for Durable Agent Workflowscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Autonomous Repair for Multi-Agent Systems via Monte-Carlo Tree Search
- 2025Beyond Reactivity: Measuring Proactive Problem Solving in LLM Agents
- 2026EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions
- 2026Unlocking Model Potentials Through Adaptive Multi-Agent Scaffolding for Efficient Issue Resolution
- 2026Agentic Synthesis against Counterexample-Supplemented Sketches
- 2026AgentFactory: Towards Automated Agentic System Design and Optimization
- 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision
- 2026Teaching Agents to Code Reliably