mlsanityData to 7 Oct 2026

Raven: The Harness of Harnesses for Composable Agentic Intelligence

arXiv 2609.33439 ↗First posted 27 Sep 2026cs.AI cs.CL cs.GTcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

As large language models advance, AI agents are moving beyond isolated, domain-specific tasks toward long-horizon, cross-domain workflows. This transition exposes two challenges: increasing harness complexity makes manual design difficult to scale, while tighter coupling to specific domains limits the generality of a single harness. The central question thus shifts from how to engineer a stronger harness for one domain to how to autonomously construct specialized harnesses, improve them through experience, and orchestrate them across domains. We introduce Raven, The Harness of Harnesses, an open-source multi-agent ecosystem that automatically constructs and evolves modular harnesses for specific models and domains, treating each executable model--harness pair as a composable unit of intelligence. To support an All-Domain Collaboration Network, its Host Agent decomposes goals, matches subtasks to specialized agents, coordinates execution dependencies, and integrates results, while a host archive and EverOS preserve experience across tasks and Skill Forge makes that experience available as reusable procedures. Our theory establishes sufficient conditions for such composition to expand reliable task coverage beyond that of the available individual agents under a shared resource budget. On complex and long-horizon tasks, Raven significantly outperforms the state-of-the-art agent systems, pushing the frontier of composable agentic intelligence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 81 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

36 of 81 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer6 Jul
  2. 2025Towards a Science of Scaling Agent Systems9 Dec
  3. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
  4. 2023AgentBench: Evaluating LLMs as Agents7 Aug

Other references · 32

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  4. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  6. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  7. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  8. 2025Humanity's Last Examcited by 467
  9. 2015Illuminating search spaces by mapping elitescited by 406
  10. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  11. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  12. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
20 more
  1. 2025Memory in the Age of AI Agentscited by 285
  2. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  3. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
  4. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
  5. 2025MemOS: A Memory OS for AI Systemcited by 129
  6. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
  7. 2026SkillRouter: Skill Routing for LLM Agents at Scalecited by 57
  8. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 35
  9. 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verificationcited by 28
  10. 2026MiroFlow: Towards High-Performance and Robust Open-Source Agent Framework for General Deep Research Taskscited by 13
  11. 2026PresentBench: A Fine-Grained Rubric-Based Benchmark for Slide Generationcited by 12
  12. 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolutioncited by 11
  13. 2026Can AI Agents Answer Your Data Questions? A Benchmark for Data Agentscited by 10
  14. 2026JobBench: Aligning Agent Work With Human Willcited by 10
  15. 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?cited by 7
  16. 2026Tencent WorkBuddy Bench: A Multi-Domain Coding-Agent Benchmark with Contamination-Resistant Task Constructioncited by 5
  17. 2026SWE Refactor Bench: Can Coding Agents Complete a Long-Horizon, Whole-Repository Stack Migration?cited by 4
  18. 2026SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agentscited by 2
  19. 2026Grow the Harness, Not the Context: From Strategy-Free Scaffolds to Reusable Specialist Agentscited by 2
  20. 2026Position: A Three-Layer Probabilistic Assume-Guarantee Architecture Is Structurally Required for Safe LLM Agent Deploymentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses
  2. 2026Harness-Zero: Harness Distillation via Agent-as-Harness
  3. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
  4. 2026The Empire, Long Divided, Must Unite: Architectural Convergence in Three LLM Agent Harnesses
  5. 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable
  6. 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems
  7. 2026PluginRSI: Recursive Improvement of Agent Harnesses with Reusable Plugins
  8. 2026Code as Agent Harness