mlsanityData to 7 Oct 2026

Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence

arXiv 2608.21156 ↗First posted 21 Aug 2026cs.IR cs.AI cs.ETcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

LLMs have evolved from language generators to autonomous agents capable of complex, long-horizon tasks. This evolution has produced paradigms including Prompt Engineering to elicit model capabilities, Context Engineering to manage information access, Harness Engineering to organize external tools and resources, and Loop Engineering to support continual reflection and self-improvement. Yet as tasks grow more complex, individual intelligence faces a fundamental limit: many tasks require heterogeneous expertise, interdependent subtasks, parallel execution, independent verification, and persistent state, exceeding any single agent's organizational capacity. Augmenting one agent's capabilities or context cannot resolve this architectural mismatch; intelligence must instead be distributed across specialized agents and organized at the system level. We call this System Intelligence: an agent system's ability to organize and coordinate multiple intelligent components into a coherent, adaptive whole pursuing a shared objective. Achieving it requires more than adding agents; it demands explicit structures to organize work, coordinate heterogeneous agents, and maintain evolving execution states. We introduce Graph Engineering, an emerging paradigm for next-generation agent systems. Unlike prior paradigms that mainly optimize individual interactions or agent-level behavior, Graph Engineering constructs explicit, dynamic, evolving graph structures representing tasks, agents, and system states. These abstractions provide a unified foundation for organizing complex objectives, orchestrating heterogeneous agents, modeling system dynamics, and enabling scalable agent evolution. We systematically review the principles, methodologies, and applications of Graph Engineering for LLM agents. Related papers, open-source data, and projects are collected at https://github.com/DEEP-JLU/Awesome-Graph-Engineering.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 227 of its 479 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

227 of 479 references.

Closest ancestors · 46

Same direction, newest first

  1. 2026MoRSE: Task-Oriented Multi-Agent System with Mixture of Role-Subtask Experts10 Aug
  2. 2026A2E : An End-to-End Agent Auditing Engine7 Aug
  3. 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks3 Aug
  4. 2026AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?31 Jul
  5. 2026Toward an Organizational Science of Multi-Agent LLM Systems: Decoupling Who, How, and Which Algorithm28 Jul
  6. 2026QueenBee Planner: Skill-Evolving Communication Topologies for Token-Efficient LLM Multi-Agent Systems25 Jun
  7. 2026MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems?22 Jun
  8. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun
  9. 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems28 May
  10. 2026BenchTrace: A Benchmark for Testing Reflection Ability and Controlled Evolution in LLM Agents28 May
  11. 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May
  12. 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems10 May
34 more
  1. 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs26 Apr
  2. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
  3. 2026SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topology19 Apr
  4. 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr
  5. 2026SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessment10 Apr
  6. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering9 Apr
  7. 2026Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures30 Mar
  8. 2026Supervising Ralph Wiggum: Exploring a Metacognitive Co-Regulation Agentic AI Loop for Engineering Design25 Mar
  9. 2026CARD: Towards Conditional Design of Multi-agent Topological Structures1 Mar
  10. 2026MAS-on-the-Fly: In-Context Structural Adaptation of LLM-Based Multi-Agent Systems14 Feb
  11. 2026DyTopo: Dynamic Topology Routing for Multi-Agent Reasoning via Semantic Matching5 Feb
  12. 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration3 Feb
  13. 2026DPBench: Structural Determinants of Multi-Agent LLM Coordination Under Simultaneous Resource Contention2 Feb
  14. 2026Multi-Agent Teams Hold Experts Back1 Feb
  15. 2025Towards a Science of Scaling Agent Systems9 Dec
  16. 2025Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agents27 Aug
  17. 2025Graph-Augmented Large Language Model Agents: Current Progress and Future Prospects29 Jul
  18. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul
  19. 2025Kimi K2: Open Agentic Intelligence28 Jul
  20. 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs11 Jul
  21. 2025Adaptive Graph Pruning for Multi-Agent Communication3 Jun
  22. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
  23. 2025Plan-over-Graph: Towards Parallelable LLM Agent Schedule20 Feb
  24. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  25. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
  26. 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
  27. 2024ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systems2 Sep
  28. 2024Automated Design of Agentic Systems15 Aug
  29. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  30. 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generation15 Feb
  31. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
  32. 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
  33. 2023AgentBench: Evaluating LLMs as Agents7 Aug
  34. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 181

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  8. 2020Scaling Laws for Neural Language Modelscited by 6,411
  9. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  10. 2024Qwen2.5 Technical Reportcited by 4,713
  11. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  12. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
38 more
  1. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  2. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  7. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  8. 2024Mixtral of Expertscited by 1,785
  9. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  10. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  11. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  12. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  13. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  14. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  15. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
  16. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  17. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  18. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  19. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  20. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
  21. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  22. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  23. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  24. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  25. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  26. 2025Group Sequence Policy Optimizationcited by 788
  27. 2024DeepSeek-V3 Technical Reportcited by 724
  28. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  29. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
  30. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
  31. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  32. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  33. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
  34. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  35. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  36. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
  37. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  38. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359

50 most cited of 181 All 181 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective
  2. 2025AMAS: Adaptively Determining Communication Topology for LLM-based Multi-Agent System
  3. 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
  4. 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents
  5. 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
  6. 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
  7. 2026Procedural Graphs: Self-Evolving Execution Structures for LLM Agents
  8. 2026The Agent Use of Agent Beings: Agent Cybernetics Is the Missing Science of Foundation Agents