mlsanityData to 7 Oct 2026

Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence

arXiv 2407.07061 ↗First posted 9 Jul 2024cs.CLcited by 80

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

The rapid advancement of large language models (LLMs) has paved the way for the development of highly capable autonomous agents. However, existing multi-agent frameworks often struggle with integrating diverse capable third-party agents due to reliance on agents defined within their own ecosystems. They also face challenges in simulating distributed environments, as most frameworks are limited to single-device setups. Furthermore, these frameworks often rely on hard-coded communication pipelines, limiting their adaptability to dynamic task requirements. Inspired by the concept of the Internet, we propose the Internet of Agents (IoA), a novel framework that addresses these limitations by providing a flexible and scalable platform for LLM-based multi-agent collaboration. IoA introduces an agent integration protocol, an instant-messaging-like architecture design, and dynamic mechanisms for agent teaming and conversation flow control. Through extensive experiments on general assistant tasks, embodied AI tasks, and retrieval-augmented generation benchmarks, we demonstrate that IoA consistently outperforms state-of-the-art baselines, showcasing its ability to facilitate effective collaboration among heterogeneous agents. IoA represents a step towards linking diverse agents in an Internet-like environment, where agents can seamlessly collaborate to achieve greater intelligence and capabilities. Our codebase has been released at urlhttps://github.com/OpenBMB/IoA.

Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 57 references that are in the map. First posted on arXiv 9 Jul 2024.

Builds on

36 of 57 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents1 Feb
  2. 2023Experiential Co-Learning of Software-Developing Agents28 Dec
  3. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  4. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  6. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 30

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  10. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  11. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  12. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
18 more
  1. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  4. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  5. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  6. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  7. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  8. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  9. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  10. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  11. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  12. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
  13. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 293
  14. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
  15. 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 171
  16. 2024StateFlow: Enhancing LLM Task-Solving through State-Driven Workflowscited by 65
  17. 2023Learning to Break: Knowledge-Enhanced Reasoning in Multi-Agent Debate Systemcited by 26
  18. 2014An Anytime Algorithm for Optimal Coalition Structure Generationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 19; 2025: 33; 2026: 28.

80 papers.

Sort:

By area:

  1. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
  2. 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
  3. 2024Large Language Model-Brained GUI Agents: A Surveycited by 160
  4. 2024ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inferencecited by 132
  5. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  6. 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networkscited by 110
  7. 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
  8. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 92
  9. 2024Beyond Browsing: API-Based Web Agentscited by 77
  10. 2025A Survey of AI Agent Protocolscited by 77
  11. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 54
  12. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
38 more
  1. 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneitycited by 43
  2. 2025Agentic Web: Weaving the Next Web with AI Agentscited by 43
  3. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent Systemcited by 40
  4. 2024SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuningcited by 32
  5. 2025Internet of Agents: Fundamentals, Applications, and Challengescited by 31
  6. 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMscited by 31
  7. 2024Circuit Complexity Bounds for RoPE-based Transformer Architecturecited by 26
  8. 2025MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulationscited by 26
  9. 2025Where Did It All Go Wrong? A Hierarchical Look into Multi-Agent Error Attributioncited by 25
  10. 2025Stronger-MAS: Multi-Agent Reinforcement Learning for Collaborative LLMscited by 25
  11. 2025Symbiotic Cooperation for Web Agents: Harnessing Complementary Strengths of Large and Small LLMscited by 24
  12. 2024Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Timecited by 22
  13. 2024LLM-based Multi-Agent Systems: Techniques and Business Perspectivescited by 22
  14. 2024Very Large-Scale Multi-Agent Simulation in AgentScopecited by 18
  15. 2025Security of Internet of Agents: Attacks and Countermeasurescited by 17
  16. 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machinescited by 17
  17. 2025Beyond Outlining: Heterogeneous Recursive Planning for Adaptive Long-form Writing with Language Modelscited by 15
  18. 2025A Cognitive Writing Perspective for Constrained Long-Form Text Generationcited by 14
  19. 2025BlockA2A: Towards Secure and Verifiable Agent-to-Agent Interoperabilitycited by 14
  20. 2024CoPS: Empowering LLM Agents with Provable Cross-Task Experience Sharingcited by 12
  21. 2025Automated Composition of Agents: A Knapsack Approach for Agentic Component Selectioncited by 10
  22. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
  23. 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMscited by 10
  24. 2024AgentMonitor: A Plug-and-Play Framework for Predictive and Secure Multi-Agent Systemscited by 9
  25. 2024Towards Foundation-model-based Multiagent System to Accelerate AI for Social Impactcited by 9
  26. 2025Amplified Vulnerabilities: Structured Jailbreak Attacks on LLM-based Multi-Agent Debatecited by 8
  27. 2025Decentralized Multi-Agent System with Trust-Aware Communicationcited by 7
  28. 2024DAWN: Designing Distributed Agents in a Worldwide Networkcited by 6
  29. 2025ACPs: Agent Collaboration Protocols for the Internet of Agentscited by 6
  30. 2025Agentic Services Computingcited by 6
  31. 2025Toward a Safe Internet of Agentscited by 6
  32. 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Modelscited by 6
  33. 2025Cross-Task Experiential Learning on LLM-based Multi-Agent Collaborationcited by 4
  34. 2024AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environmentcited by 3
  35. 2025Neural Algorithmic Reasoning for Hypergraphs with Looped Transformerscited by 3
  36. 2025Agent-as-a-Service based on Agent Networkcited by 3
  37. 2025Co-Saving: Resource Aware Multi-Agent Collaboration for Software Developmentcited by 3
  38. 2025ManiAgent: An Agentic Framework for General Robotic Manipulationcited by 3

50 most cited of 80 All 80 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025A Layered Protocol Architecture for the Internet of Agents
  2. 2026The Internet of Agentic AI: Communication, Coordination, and Collective Intelligence at Scale
  3. 2026Internet of Agentic AI: Incentive-Compatible Distributed Teaming and Workflow
  4. 2026AONA: A Comprehensive Architecture and Workflow Design for Global Agentic Collaboration
  5. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
  6. 2024Towards Effective GenAI Multi-Agent Collaboration: Design and Evaluation for Enterprise Applications
  7. 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems
  8. 2025From Multi-Agent Systems and the Semantic Web to Agentic AI: A Unified Narrative of the Web of Agents