mlsanityData to 7 Oct 2026

More Agents Is All You Need

arXiv 2402.05120 ↗First posted 3 Feb 2024cs.CL cs.AI cs.LGcited by 174

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

We find that, simply via a sampling-and-voting method, the performance of large language models (LLMs) scales with the number of agents instantiated. Also, this method, termed as Agent Forest, is orthogonal to existing complicated methods to further enhance LLMs, while the degree of enhancement is correlated to the task difficulty. We conduct comprehensive experiments on a wide range of LLM benchmarks to verify the presence of our finding, and to study the properties that can facilitate its occurrence. Our code is publicly available at: https://github.com/MoreAgentsIsAllYouNeed/AgentForest

Key facts. Cited by 174 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 29 of its 40 references that are in the map. First posted on arXiv 3 Feb 2024.

Builds on

29 of 40 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
  2. 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
  3. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug

Other references · 25

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  10. 2023A Survey of Large Language Modelscited by 2,537
  11. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  12. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
13 more
  1. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  2. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  3. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  4. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
  5. 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
  6. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
  7. 2023Large Language Model Routing with Benchmark Datasetscited by 166
  8. 2017Controlling Linguistic Style Aspects in Neural Language Generationcited by 147
  9. 2023Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Modelscited by 141
  10. 2024Knowledge Fusion of Large Language Modelscited by 110
  11. 2023Fusing Models with Complementary Expertisecited by 45
  12. 2024Blending Is All You Need: Cheaper, Better Alternative to Trillion-Parameters LLMcited by 26
  13. 2023Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarioscited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 34; 2025: 59; 2026: 81.

174 papers.

Sort:

By area:

  1. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
  2. 2024AI Agents That Mattercited by 199
  3. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
  4. 2025Towards a Science of Scaling Agent Systemscited by 125
  5. 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networkscited by 110
  6. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
  7. 2025Harnessing Multiple Large Language Models: A Survey on LLM Ensemblecited by 86
  8. 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 85
  9. 2024RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Modelscited by 84
  10. 2024Preble: Efficient Distributed Prompt Scheduling for LLM Servingcited by 68
  11. 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 68
  12. 2024Archon: An Architecture Search Framework for Inference-Time Techniquescited by 59
38 more
  1. 2024Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimizationcited by 56
  2. 2025Rethinking Mixture-of-Agents: Is Mixing Different Large Language Models Beneficial?cited by 52
  3. 2024The Limits of Inference Scaling Through Resamplingcited by 51
  4. 2024A Scalable Communication Protocol for Networks of Large Language Modelscited by 43
  5. 2024WARP: On the Benefits of Weight Averaged Rewarded Policiescited by 42
  6. 2024MAgICoRe: Multi-Agent, Iterative, Coarse-to-Fine Refinement for Reasoningcited by 40
  7. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent Systemcited by 40
  8. 2025Evaluation of Best-of-N Sampling Strategies for Language Model Alignmentcited by 38
  9. 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agentscited by 35
  10. 2025Hogwild! Inference: Parallel LLM Generation via Concurrent Attentioncited by 32
  11. 2025Internet of Agents: Fundamentals, Applications, and Challengescited by 31
  12. 2026Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgetscited by 28
  13. 2024Playable Game Generationcited by 26
  14. 2026MAS-Orchestra: Understanding and Improving Multi-Agent Reasoning Through Holistic Orchestration and Controlled Benchmarkscited by 26
  15. 2024Provable Scaling Laws for the Test-Time Compute of Large Language Modelscited by 25
  16. 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversitycited by 25
  17. 2024StructuredRAG: JSON Response Formatting with Large Language Modelscited by 22
  18. 2024ACC-Collab: An Actor-Critic Approach to Multi-Agent LLM Collaborationcited by 22
  19. 2025Emergent Coordination in Multi-Agent Language Modelscited by 22
  20. 2026Recursive Harness Self-Improvementcited by 22
  21. 2025Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Computecited by 20
  22. 2024Agentic Information Retrievalcited by 19
  23. 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Securitycited by 19
  24. 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memorycited by 19
  25. 2025Online Multi-LLM Selection via Contextual Bandits under Unstructured Context Evolutioncited by 18
  26. 2024Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model Reasoningcited by 16
  27. 2025Simulating Rumor Spreading in Social Networks using LLM Agentscited by 16
  28. 2025Adaptive Graph of Thoughts: Test-Time Adaptive Reasoning Unifying Chain, Tree, and Graph Structurescited by 16
  29. 2025Incentivizing LLMs to Self-Verify Their Answerscited by 16
  30. 2024Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interfacecited by 15
  31. 2025Yan: Foundational Interactive Video Generationcited by 15
  32. 2025Generative AI Act II: Test Time Scaling Drives Cognition Engineeringcited by 14
  33. 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systemscited by 14
  34. 2024GenAINet: Enabling Wireless Collective Intelligence via Knowledge Transfer and Reasoningcited by 13
  35. 2024Networks of Networks: Complexity Class Principles Applied to Compound AI Systems Designcited by 13
  36. 2025Byzantine-Robust Decentralized Coordination of LLM Agentscited by 13
  37. 2025Consensus Entropy: Harnessing Multi-VLM Agreement for Self-Verifying and Self-Improving OCRcited by 12
  38. 2026ALL-FEM: Agentic Large Language models Fine-tuned for Finite Element Methodscited by 12

50 most cited of 174 All 174 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models
  2. 2023AgentBench: Evaluating LLMs as Agents
  3. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents
  4. 2023AgentSims: An Open-Source Sandbox for Large Language Model Evaluation
  5. 2026Can Small Agents Collaborate to Beat a Single Large Language Model?
  6. 2026The Illusion of Stochasticity in LLMs
  7. 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey
  8. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges