MonoScale: Scaling Multi-Agent System with Monotonic Improvement
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
In recent years, LLM-based multi-agent systems (MAS) have advanced rapidly, using a router to decompose tasks and delegate subtasks to specialized agents. A natural way to expand capability is to scale up the agent pool by continually integrating new functional agents or tool interfaces, but naive expansion can trigger performance collapse when the router cold-starts on newly added, heterogeneous, and unreliable agents. We propose MonoScale, an expansion-aware update framework that proactively generates a small set of agent-conditioned familiarization tasks, harvests evidence from both successful and failed interactions, and distills it into auditable natural-language memory to guide future routing. We formalize sequential augmentation as a contextual bandit and perform trust-region memory updates, yielding a monotonic non-decreasing performance guarantee across onboarding rounds. Experiments on GAIA and Humanity's Last Exam show stable gains as the agent pool grows, outperforming naive scale-up and strong-router fixed-pool baselines.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 46 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
28 of 46 references.
Closest ancestors · 11
Same direction, newest first
- 2026EvoRoute: Experience-Driven Self-Routing LLM Agent Systems6 Jan
- 2025RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory6 Aug
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems1 Apr
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application23 Dec
- 2024MorphAgent: Empowering Agents through Self-Evolving Profiles and Decentralized Collaboration19 Oct
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2024Language Agents as Optimizable Graphs26 Feb
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 17
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2017Safe Policy Improvement with Baseline Bootstrappingcited by 141
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 113
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
- 2025Agentic Web: Weaving the Next Web with AI Agentscited by 43
- 2025The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giantscited by 37
- 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agentscited by 34
- 2025ICL-Router: In-Context Learned Model Representations for LLM Routingcited by 26
- 2025Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Frameworkcited by 25
5 more
- 2025LoopTool: Closing the Data-Training Loop for Robust LLM Tool Callscited by 16
- 2019Deep Conservative Policy Iterationcited by 14
- 2025Enhancing Agentic RL with Progressive Reward Shaping and Value-based Sampling Policy Optimizationcited by 9
- 2025CATArena: Evaluating Evolutionary Capabilities of Code Agents via Iterative Tournamentscited by 5
- 2025Near-Optimal Online Deployment and Routing for Streaming LLMscited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026MMSkills: Towards Multimodal Skills for General Visual Agentscited by 13
- 2026Scaling Discovery through Test-Time Communicationcited by 4
- 2026Retrieval-Conditioned Topology Selection with Provable Budget Conservation for Multi-Agent Code Generationcited by 1
- 2026PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneitycited by 0
- 2026Testing and Evaluation of Agentic AI Systems In Military Command and Controlcited by 0
- 2026Scaling Discovery through Test-Time Communication17 Sep 2026
- 2026Testing and Evaluation of Agentic AI Systems In Military Command and Control20 Aug 2026
- 2026PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneity22 Jul 2026
- 2026MMSkills: Towards Multimodal Skills for General Visual Agents13 May 2026
- 2026Retrieval-Conditioned Topology Selection with Provable Budget Conservation for Multi-Agent Code Generation7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversity
- 2026Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs
- 2026Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems
- 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
- 2026ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systems
- 2026TeamTR: Trust-Region Fine-Tuning for Multi-Agent LLM Coordination