mlsanityData to 14 Oct 2026

AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design

arXiv 2608.13560 ↗First posted 13 Aug 2026cs.CV cs.AI cs.CLcited by 9

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process centered on a model-harness system. While an ideal harness system should align with human design priors and accumulate reusable experience through empirical exploration to drive recursive self-improvement, existing paradigms remain static and fall short of this capability. In this paper, we present AutoDesign, a framework that aligns with human design priors, where a meta-harness optimizer guides a code agent to recursively improve harness based on rollout feedback. To instantiate and evaluate this framework, we focus on the academic paper-to-poster generation task and introduce PosterBench, comprising a 100-paper Main Track spanning five disciplines and PosterBench-mini, a shared 10-paper subset for controlled evaluation. On the PosterBench Main Track, AutoDesign achieves the highest score of 78.32, surpassing the closed-source commercial system Claude Design by 7.45 points. Across seven controlled code-agent-model configurations, integrating the learned DesignHarness consistently improves performance, increasing the average PosterBench Score from 54.99 to 67.39 (+12.4%). In a fully autonomous long-horizon loop, it executes 253 tool calls and 11 editing turns within 40 minutes for under 3, reaching average conference-poster quality in human evaluation. A system-blind human study further demonstrates that AutoDesign achieves the highest human preference among evaluated systems.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 81 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

43 of 81 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs24 Aug

Other references · 42

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  5. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  6. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  7. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  8. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  9. 2024Automated Design of Agentic Systemscited by 407
  10. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  11. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  12. 2024TextGrad: Automatic "Differentiation" via Textcited by 273
30 more
  1. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
  2. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  3. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
  4. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
  5. 2026Self-Harness: Harnesses That Improve Themselvescited by 107
  6. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 95
  7. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
  8. 2025A Self-Improving Coding Agentcited by 79
  9. 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 70
  10. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
  11. 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
  12. 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 53
  13. 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 47
  14. 2026Continual Harness: Online Adaptation for Self-Improving Foundation Agentscited by 41
  15. 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
  16. 2026Recursive Harness Self-Improvementcited by 32
  17. 2024UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedbackcited by 27
  18. 2026Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streamscited by 27
  19. 2025Paper2Video: Automatic Video Generation from Scientific Paperscited by 24
  20. 2025Auto-Slides: An Interactive Multi-Agent System for Creating and Customizing Research Presentationscited by 19
  21. 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 19
  22. 2025P2P: Automated Paper-to-Poster Generation and Fine-Grained Benchmarkcited by 17
  23. 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posterscited by 14
  24. 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 13
  25. 2025IGD: Instructional Graphic Design with Multimodal Layer Generationcited by 8
  26. 2025PosterForest: Hierarchical Multi-Agent Collaboration for Scientific Poster Generationcited by 8
  27. 2026Recursive Self-Evolving Agents via Held-Out Selectioncited by 7
  28. 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 5
  29. 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 5
  30. 2026Any2Poster: Any-Source Poster Generation Across Modalities and Domainscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design
  2. 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agents
  3. 2025Frontend Diffusion: Empowering Self-Representation of Junior Researchers and Designers Through Multi-agent System
  4. 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents
  5. 2026Enabling Creative Exploration for Vibe Design Agents
  6. 2026ADIAS: Automated Design of Interactive Agentic Systems
  7. 2024LLM4DESIGN: An Automated Multi-Modal System for Architectural and Environmental Design
  8. 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnesses