mlsanityData to 14 Oct 2026

Herding CATs: ALARA for Agent Harness Engineering in Portable Composable Multi-Agent Teams

arXiv 2603.20380 ↗First posted 20 Mar 2026cs.MA cs.AI cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

Industry practitioners and academic researchers regularly use multi-agent systems to accelerate their work, but the applications through which users operate these systems do not provide a simple, unified mechanism for scalably managing critical components of the agent harness. This lack of control adversely impacts both the quality of individual human-agent interactions and reduces the capacity for practitioners to coordinate context engineering efforts. The behavioral specifications that define what agents in such systems can do remain fragmented across prose instruction files -- for which compliance cannot be guaranteed -- or framework-internal configurations, making these specifications difficult to share, version, or collaboratively maintain across teams and projects. Applying the ALARA principle from radiation safety (exposures kept as low as reasonably achievable) to context, we introduce a context-agent-tool (CAT) data layer expressed through interrelated plain-text files, allowing users to directly declare tool access for each agent and to modify the tools themselves that are used by the agents when processing. We demonstrate capability of this CAT data layer to enable real agentic usage by using a command-line shell that loads the team and executes agent runs -- textttnpcsh -- and evaluating 22 locally-hosted models from 0.6B to 35B parameters across 115 practical tasks spanning file operations, web search, multi-step scripting, tool chaining, and multi-agent delegation. We characterize which model families succeed in certain task categories and where they break down across ~2500 total executions.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 57 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

34 of 57 references.

References · 34

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  8. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  9. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  10. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  11. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  12. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
22 more
  1. 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
  2. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
  3. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 290
  4. 2024AI Agents That Mattercited by 219
  5. 2024Lessons from the Trenches on Reproducible Evaluation of Language Modelscited by 179
  6. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
  7. 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 144
  8. 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
  9. 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 128
  10. 2024SWE-Bench+: Enhanced Coding Benchmark for LLMscited by 99
  11. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agentcited by 93
  12. 2025Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agentscited by 87
  13. 2025Design Patterns for Securing LLM Agents against Prompt Injectionscited by 73
  14. 2025Levels of Autonomy for AI Agentscited by 48
  15. 2026When Single-Agent with Skills Replace Multi-Agent Systems and When They Failcited by 35
  16. 2025Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literaturecited by 11
  17. 2025Everything is Context: Agentic File System Abstraction for Context Engineeringcited by 6
  18. 2025A quantum semantic framework for natural language processingcited by 5
  19. 2025ADL: A Declarative Language for Agent-Based Chatbotscited by 3
  20. 2026From Everything-is-a-File to Files-Are-All-You-Need: How Unix Philosophy Informs the Design of Agentic AI Systemscited by 2
  21. 2026Fundamental Limits of Quantum Semantic Communication via Sheaf Cohomologycited by 1
  22. 2026Engineering AI Agents for Clinical Workflows: A Case Study in Architecture,MLOps, and Governancecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Code as Agent Harness
  2. 2026Raven: The Harness of Harnesses for Composable Agentic Intelligence
  3. 2026SemaClaw: A Step Towards General-Purpose Personal AI Agents through Harness Engineering
  4. 2026Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflows
  5. 2026Harness-Zero: Harness Distillation via Agent-as-Harness
  6. 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems
  7. 2026AI Agents Do Not Fail Alone:The Context Fails First
  8. 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable