Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
LLMs have evolved from language generators to autonomous agents capable of complex, long-horizon tasks. This evolution has produced paradigms including Prompt Engineering to elicit model capabilities, Context Engineering to manage information access, Harness Engineering to organize external tools and resources, and Loop Engineering to support continual reflection and self-improvement. Yet as tasks grow more complex, individual intelligence faces a fundamental limit: many tasks require heterogeneous expertise, interdependent subtasks, parallel execution, independent verification, and persistent state, exceeding any single agent's organizational capacity. Augmenting one agent's capabilities or context cannot resolve this architectural mismatch; intelligence must instead be distributed across specialized agents and organized at the system level. We call this System Intelligence: an agent system's ability to organize and coordinate multiple intelligent components into a coherent, adaptive whole pursuing a shared objective. Achieving it requires more than adding agents; it demands explicit structures to organize work, coordinate heterogeneous agents, and maintain evolving execution states. We introduce Graph Engineering, an emerging paradigm for next-generation agent systems. Unlike prior paradigms that mainly optimize individual interactions or agent-level behavior, Graph Engineering constructs explicit, dynamic, evolving graph structures representing tasks, agents, and system states. These abstractions provide a unified foundation for organizing complex objectives, orchestrating heterogeneous agents, modeling system dynamics, and enabling scalable agent evolution. We systematically review the principles, methodologies, and applications of Graph Engineering for LLM agents. Related papers, open-source data, and projects are collected at https://github.com/DEEP-JLU/Awesome-Graph-Engineering.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 227 of its 479 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
227 of 479 references.
Closest ancestors · 46
Same direction, newest first
- 2026MoRSE: Task-Oriented Multi-Agent System with Mixture of Role-Subtask Experts10 Aug
- 2026A2E : An End-to-End Agent Auditing Engine7 Aug
- 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks3 Aug
- 2026AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?31 Jul
- 2026Toward an Organizational Science of Multi-Agent LLM Systems: Decoupling Who, How, and Which Algorithm28 Jul
- 2026QueenBee Planner: Skill-Evolving Communication Topologies for Token-Efficient LLM Multi-Agent Systems25 Jun
- 2026MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems?22 Jun
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems28 May
- 2026BenchTrace: A Benchmark for Testing Reflection Ability and Controlled Evolution in LLM Agents28 May
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems10 May
34 more
- 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs26 Apr
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
- 2026SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topology19 Apr
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr
- 2026SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessment10 Apr
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering9 Apr
- 2026Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures30 Mar
- 2026Supervising Ralph Wiggum: Exploring a Metacognitive Co-Regulation Agentic AI Loop for Engineering Design25 Mar
- 2026CARD: Towards Conditional Design of Multi-agent Topological Structures1 Mar
- 2026MAS-on-the-Fly: In-Context Structural Adaptation of LLM-Based Multi-Agent Systems14 Feb
- 2026DyTopo: Dynamic Topology Routing for Multi-Agent Reasoning via Semantic Matching5 Feb
- 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration3 Feb
- 2026DPBench: Structural Determinants of Multi-Agent LLM Coordination Under Simultaneous Resource Contention2 Feb
- 2026Multi-Agent Teams Hold Experts Back1 Feb
- 2025Towards a Science of Scaling Agent Systems9 Dec
- 2025Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agents27 Aug
- 2025Graph-Augmented Large Language Model Agents: Current Progress and Future Prospects29 Jul
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul
- 2025Kimi K2: Open Agentic Intelligence28 Jul
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs11 Jul
- 2025Adaptive Graph Pruning for Multi-Agent Communication3 Jun
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
- 2025Plan-over-Graph: Towards Parallelable LLM Agent Schedule20 Feb
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
- 2024ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systems2 Sep
- 2024Automated Design of Agentic Systems15 Aug
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
- 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generation15 Feb
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
- 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 181
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
38 more
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2024Mixtral of Expertscited by 1,785
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2025Group Sequence Policy Optimizationcited by 788
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
50 most cited of 181 All 181 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective
- 2025AMAS: Adaptively Determining Communication Topology for LLM-based Multi-Agent System
- 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents
- 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
- 2026Procedural Graphs: Self-Evolving Execution Structures for LLM Agents
- 2026The Agent Use of Agent Beings: Agent Cybernetics Is the Missing Science of Foundation Agents