GraphMind: From Operational Traces to Self-Evolving Workflow Automation
On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents
Abstract (arXiv)
Complex operational workflows coordinating personnel, tools, and information are central to system operations, yet end-to-end automation remains challenging due to extensive human input requirements and limited ability to adapt over time. We present GraphMind, a system that constructs, executes, and evolves action-centric workflow graphs with minimal human effort. The system operates in three phases. First, a scalable offline pipeline extracts structured workflow graphs from large volumes of human resolution traces, capturing problems, actions, and their causal relationships. Second, an online multi-agent traversal engine navigates the graph to dynamically construct and execute workflows, combining graph-guided retrieval with LLM-driven reasoning at each step. Third, Adaptive Traversal Reinforcement (ATR) reinforces successful traversal paths, enabling execution-informed graph adaptation. GraphMind has been deployed across four production cloud database services for incident investigation. Evaluated on 93 held-out incidents and validated via blind expert review, the system outperforms an Agentic Summary-RAG baseline in mitigation reach, hallucination rate, and diagnostic throughput while requiring 8x less retrieval context. The ATR layer reduces hallucination rate by 26%, demonstrating that workflow graphs can learn from execution feedback. A 12-week field study confirms practical value: 97% of scored conversations yield actionable results within interactive latency.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 16 of its 45 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
16 of 45 references.
References · 16
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 187
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
4 more
- 2024OG-RAG: Ontology-Grounded Retrieval-Augmented Generation For Large Language Modelscited by 23
- 2026Cloud-OpsBench: A Reproducible Benchmark for Agentic Root Cause Analysis in Cloud Systemscited by 15
- 2025FLAIR: Feedback Learning for Adaptive Information Retrievalcited by 4
- 2024ENCO: Life-Cycle Management of Enterprise-Grade Copilotscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Towards an AI Software Factory for Data Systemscited by 0
- 2026Towards an AI Software Factory for Data Systems28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration
- 2026Adaptive Multimodal Agents-Based Framework for Automatic Workflow Execution
- 2026GraphFlow: A Graph-Based Workflow Management for Efficient LLM-Agent Serving
- 2025AgentCompass: Towards Reliable Evaluation of Agentic Workflows in Production
- 2026GraphFlow: An Architecture for Formally Verifiable Visual Workflows Enabling Reliable Agentic AI Automation
- 2026FlowScout: From Execution Feedback to Reliable Tool-Using Agent Workflows
- 2026It Takes Workflows to Evolve Better Workflows
- 2026FlowSteer: Towards Agents Designing Agentic Workflows via Reinforced Progressive Canvas Editing