mlsanityData to 7 Oct 2026

AgentSlimming: Towards Efficient and Cost-Aware Multi-Agent Systems

arXiv 2605.08813 ↗First posted 9 May 2026cs.LGcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large Language Model-based Multi-Agent Systems (MAS) have demonstrated remarkable capabilities in complex tasks. However, manually designing optimal communication topologies is labor-intensive, while automated expansion methods often result in bloated structures with redundant agents, leading to excessive token consumption. To address this problem, we introduce AgentSlimming, a plug-and-play compression framework for graph-structured multi-agent workflows. Motivated by pruning and quantization in neural networks, AgentSlimming compresses workflows by first estimating the importance score of each agent with a hybrid mechanism, and then removes redundant agents or replaces them with low-cost ones, where each operation is validated using a baseline-anchored acceptance rule to prevent performance collapse. Experiments show that AgentSlimming reduces average token cost by up to 78.9% with negligible performance degradation, and sometimes even improves accuracy, achieving a strong Pareto-optimal trade-off between cost and quality. textitOur code is publicly available at https://github.com/CitrusYL/AgentSlimming

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 37 of its 60 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

37 of 60 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025SafeSieve: From Heuristics to Experience in Progressive Pruning for LLM-based Multi-Agent Communication15 Aug
  2. 2025Adaptive Graph Pruning for Multi-Agent Communication3 Jun
  3. 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
  4. 2023Lemur: Harmonizing Natural Language and Code for Language Agents10 Oct
  5. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
  6. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul
  7. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 30

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2021Program Synthesis with Large Language Modelscited by 3,509
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  8. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  9. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  10. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  11. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  12. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
18 more
  1. 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
  2. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
  3. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  4. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  5. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881
  6. 2023Large Language Models as Optimizerscited by 830
  7. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  8. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  9. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
  10. 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
  11. 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
  12. 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
  13. 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 100
  14. 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
  15. 2024Archon: An Architecture Search Framework for Inference-Time Techniquescited by 59
  16. 2019Learning Agent Communication under Limited Bandwidth by Message Pruningcited by 31
  17. 2024MobileExperts: A Dynamic Tool-Enabled Agent Team in Mobile Devicescited by 29
  18. 2024HAIChart: Human and AI Paired Visualization Systemcited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentCompress: Task-Aware Compression for Affordable Large Language Model Agents
  2. 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries
  3. 2026When Parallelism Pays Off: Cohesion-Aware Task Partitioning for Multi-Agent Coding
  4. 2026Reinforced Collaboration in Multi-Agent Flow Networks
  5. 2026AgentFactory: Towards Automated Agentic System Design and Optimization
  6. 2026AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction
  7. 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
  8. 2025Reducing Cost of LLM Agents with Trajectory Reduction