AgentSlimming: Towards Efficient and Cost-Aware Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large Language Model-based Multi-Agent Systems (MAS) have demonstrated remarkable capabilities in complex tasks. However, manually designing optimal communication topologies is labor-intensive, while automated expansion methods often result in bloated structures with redundant agents, leading to excessive token consumption. To address this problem, we introduce AgentSlimming, a plug-and-play compression framework for graph-structured multi-agent workflows. Motivated by pruning and quantization in neural networks, AgentSlimming compresses workflows by first estimating the importance score of each agent with a hybrid mechanism, and then removes redundant agents or replaces them with low-cost ones, where each operation is validated using a baseline-anchored acceptance rule to prevent performance collapse. Experiments show that AgentSlimming reduces average token cost by up to 78.9% with negligible performance degradation, and sometimes even improves accuracy, achieving a strong Pareto-optimal trade-off between cost and quality. textitOur code is publicly available at https://github.com/CitrusYL/AgentSlimming
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 37 of its 60 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
37 of 60 references.
Closest ancestors · 7
Same direction, newest first
- 2025SafeSieve: From Heuristics to Experience in Progressive Pruning for LLM-based Multi-Agent Communication15 Aug
- 2025Adaptive Graph Pruning for Multi-Agent Communication3 Jun
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
- 2023Lemur: Harmonizing Natural Language and Code for Language Agents10 Oct
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 30
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
18 more
- 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881
- 2023Large Language Models as Optimizerscited by 830
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
- 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
- 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 100
- 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
- 2024Archon: An Architecture Search Framework for Inference-Time Techniquescited by 59
- 2019Learning Agent Communication under Limited Bandwidth by Message Pruningcited by 31
- 2024MobileExperts: A Dynamic Tool-Enabled Agent Team in Mobile Devicescited by 29
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AgentCompress: Task-Aware Compression for Affordable Large Language Model Agents
- 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries
- 2026When Parallelism Pays Off: Cohesion-Aware Task Partitioning for Multi-Agent Coding
- 2026Reinforced Collaboration in Multi-Agent Flow Networks
- 2026AgentFactory: Towards Automated Agentic System Design and Optimization
- 2026AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction
- 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
- 2025Reducing Cost of LLM Agents with Trajectory Reduction