AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process centered on a model-harness system. While an ideal harness system should align with human design priors and accumulate reusable experience through empirical exploration to drive recursive self-improvement, existing paradigms remain static and fall short of this capability. In this paper, we present AutoDesign, a framework that aligns with human design priors, where a meta-harness optimizer guides a code agent to recursively improve harness based on rollout feedback. To instantiate and evaluate this framework, we focus on the academic paper-to-poster generation task and introduce PosterBench, comprising a 100-paper Main Track spanning five disciplines and PosterBench-mini, a shared 10-paper subset for controlled evaluation. On the PosterBench Main Track, AutoDesign achieves the highest score of 78.32, surpassing the closed-source commercial system Claude Design by 7.45 points. Across seven controlled code-agent-model configurations, integrating the learned DesignHarness consistently improves performance, increasing the average PosterBench Score from 54.99 to 67.39 (+12.4%). In a fully autonomous long-horizon loop, it executes 253 tool calls and 11 editing turns within 40 minutes for under 3, reaching average conference-poster quality in human evaluation. A system-blind human study further demonstrates that AutoDesign achieves the highest human preference among evaluated systems.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 81 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
43 of 81 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2024Automated Design of Agentic Systemscited by 407
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2024TextGrad: Automatic "Differentiation" via Textcited by 273
30 more
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
- 2026Self-Harness: Harnesses That Improve Themselvescited by 107
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 95
- 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
- 2025A Self-Improving Coding Agentcited by 79
- 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 70
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 53
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 47
- 2026Continual Harness: Online Adaptation for Self-Improving Foundation Agentscited by 41
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
- 2026Recursive Harness Self-Improvementcited by 32
- 2024UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedbackcited by 27
- 2026Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streamscited by 27
- 2025Paper2Video: Automatic Video Generation from Scientific Paperscited by 24
- 2025Auto-Slides: An Interactive Multi-Agent System for Creating and Customizing Research Presentationscited by 19
- 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 19
- 2025P2P: Automated Paper-to-Poster Generation and Fine-Grained Benchmarkcited by 17
- 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posterscited by 14
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 13
- 2025IGD: Instructional Graphic Design with Multimodal Layer Generationcited by 8
- 2025PosterForest: Hierarchical Multi-Agent Collaboration for Scientific Poster Generationcited by 8
- 2026Recursive Self-Evolving Agents via Held-Out Selectioncited by 7
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 5
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 5
- 2026Any2Poster: Any-Source Poster Generation Across Modalities and Domainscited by 5
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026Editable Visual Designcited by 0
- 2026AutoRef: Harness Optimization for Agentic Multi-Reference Image Generationcited by 0
- 2026Mixture of Self-Improving Branches For Agent Harness Optimizationcited by 0
- 2026Turbo Harness: Instance-Adaptive Harness Optimizationcited by 0
- 2026Causal Improvement Graph for Agentic Harness Optimizationcited by 0
- 2026VepAgent: Bridging Causal-Transition via Tool-Augmented Reinforcement Learning for Video Event Predictioncited by 0
- 2026Heterogeneous Agentic Coevolutioncited by 0
- 2026X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoningcited by 0
- 2026X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoning12 Oct 2026
- 2026Heterogeneous Agentic Coevolution12 Oct 2026
- 2026VepAgent: Bridging Causal-Transition via Tool-Augmented Reinforcement Learning for Video Event Prediction5 Oct 2026
- 2026Causal Improvement Graph for Agentic Harness Optimization4 Oct 2026
- 2026Turbo Harness: Instance-Adaptive Harness Optimization30 Sep 2026
- 2026Mixture of Self-Improving Branches For Agent Harness Optimization29 Sep 2026
- 2026AutoRef: Harness Optimization for Agentic Multi-Reference Image Generation28 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Editable Visual Design3 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design
- 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agents
- 2025Frontend Diffusion: Empowering Self-Representation of Junior Researchers and Designers Through Multi-agent System
- 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents
- 2026Enabling Creative Exploration for Vibe Design Agents
- 2026ADIAS: Automated Design of Interactive Agentic Systems
- 2024LLM4DESIGN: An Automated Multi-Modal System for Architectural and Environmental Design
- 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnesses