mlsanityData to 7 Oct 2026

MonoScale: Scaling Multi-Agent System with Monotonic Improvement

arXiv 2601.23219 ↗First posted 30 Jan 2026cs.MA cs.AIcited by 5

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

In recent years, LLM-based multi-agent systems (MAS) have advanced rapidly, using a router to decompose tasks and delegate subtasks to specialized agents. A natural way to expand capability is to scale up the agent pool by continually integrating new functional agents or tool interfaces, but naive expansion can trigger performance collapse when the router cold-starts on newly added, heterogeneous, and unreliable agents. We propose MonoScale, an expansion-aware update framework that proactively generates a small set of agent-conditioned familiarization tasks, harvests evidence from both successful and failed interactions, and distills it into auditable natural-language memory to guide future routing. We formalize sequential augmentation as a contextual bandit and perform trust-region memory updates, yielding a monotonic non-decreasing performance guarantee across onboarding rounds. Experiments on GAIA and Humanity's Last Exam show stable gains as the agent pool grows, outperforming naive scale-up and strong-router fixed-pool baselines.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 46 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

28 of 46 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026EvoRoute: Experience-Driven Self-Routing LLM Agent Systems6 Jan
  2. 2025RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory6 Aug
  3. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
  4. 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems1 Apr
  5. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application23 Dec
  6. 2024MorphAgent: Empowering Agents through Self-Evolving Profiles and Decentralized Collaboration19 Oct
  7. 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
  8. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  9. 2024Language Agents as Optimizable Graphs26 Feb
  10. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
  11. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  4. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  5. 2017Safe Policy Improvement with Baseline Bootstrappingcited by 141
  6. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 113
  7. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
  8. 2025Agentic Web: Weaving the Next Web with AI Agentscited by 43
  9. 2025The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giantscited by 37
  10. 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agentscited by 34
  11. 2025ICL-Router: In-Context Learned Model Representations for LLM Routingcited by 26
  12. 2025Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Frameworkcited by 25
5 more
  1. 2025LoopTool: Closing the Data-Training Loop for Robust LLM Tool Callscited by 16
  2. 2019Deep Conservative Policy Iterationcited by 14
  3. 2025Enhancing Agentic RL with Progressive Reward Shaping and Value-based Sampling Policy Optimizationcited by 9
  4. 2025CATArena: Evaluating Evolutionary Capabilities of Code Agents via Iterative Tournamentscited by 5
  5. 2025Near-Optimal Online Deployment and Routing for Streaming LLMscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversity
  2. 2026Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems
  3. 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
  4. 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs
  5. 2026Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems
  6. 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
  7. 2026ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systems
  8. 2026TeamTR: Trust-Region Fine-Tuning for Multi-Agent LLM Coordination