mlsanityData to 13 Oct 2026

LLMs+Graphs: Toward Graph-Native, Synergistic AI Systems

arXiv 2606.11560 ↗First posted 10 Jun 2026cs.DB cs.AIcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Large Language Models (LLMs) have advanced rapidly, but their limitations in structured and multi-hop reasoning underscore the need for graph-native, synergistic artificial intelligence (AI) systems. Graph-structured data underpins critical applications across social, biological, financial, transportation, web, and knowledge domains, making it essential to understand how LLMs can leverage graph computation for grounded, context-rich inference. Three complementary synergies are emerging: LLMs augmented with graph computation for retrieval and reasoning; bidirectional integration between LLMs and knowledge graphs (KGs), where LLMs support KG construction and curation while KGs enforce semantic constraints and factual consistency; and AI agents strengthened by graph algorithms for planning, decision making, and multi-step reasoning. In parallel, LLMs introduce new capabilities for graph data management and graph machine learning (ML) through natural language interfaces and hybrid LLM-graph neural network (GNN) pipelines. This tutorial synthesizes the algorithms, systems, and design principles driving these converging directions, offering data science and data mining researchers a unified perspective on integrating LLMs, graph data management, graph mining, graph ML, and agentic computation into next-generation graph-native AI systems.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 59 of its 82 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

59 of 82 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Cost-Efficient RAG for Entity Matching with LLMs: A Blocking-based Exploration5 Feb
  2. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models16 Oct
  3. 2024Scalable and Accurate Graph Reasoning with LLM-based Multi-Agents7 Oct
  4. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph17 Feb
  5. 2023Evaluating and Enhancing Large Language Models for Conversational Reasoning on Knowledge Graphs18 Dec
  6. 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models17 Aug

Other references · 53

  1. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,433
  2. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 879
  3. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 666
  4. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  5. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  6. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  7. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  8. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 275
  9. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
  10. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 240
  11. 2023Language is All a Graph Needscited by 219
  12. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 191
38 more
  1. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  2. 2019BERT for Coreference Resolution: Baselines and Analysiscited by 125
  3. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
  4. 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
  5. 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 84
  6. 2021Can Language Models be Biomedical Knowledge Bases?cited by 83
  7. 2024GRAG: Graph Retrieval-Augmented Generationcited by 78
  8. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  9. 2024A Survey of Large Language Models for Graphscited by 72
  10. 2024Can GNN be Good Adapter for LLMs?cited by 71
  11. 2023Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofittingcited by 70
  12. 2023Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answeringcited by 64
  13. 2024GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Taskscited by 63
  14. 2025PathRAG: Pruning Graph-based Retrieval Augmented Generation with Relational Pathscited by 60
  15. 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 56
  16. 2025In-depth Analysis of Graph-based RAG in a Unified Frameworkcited by 46
  17. 2024Can Graph Learning Improve Planning in LLM-based Agents?cited by 43
  18. 2025Graph Foundation Models: A Comprehensive Surveycited by 43
  19. 2024KG-Rank: Enhancing Large Language Models for Medical QA with Knowledge Graphs and Ranking Techniquescited by 37
  20. 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 31
  21. 2025ArchRAG: Attributed Community-based Hierarchical Retrieval-Augmented Generationcited by 28
  22. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
  23. 2024Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphscited by 24
  24. 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
  25. 2025DynTaskMAS: A Dynamic Task Graph-driven Framework for Asynchronous and Parallel LLM-based Multi-Agent Systemscited by 20
  26. 2024InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integrationcited by 19
  27. 2024A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applicationscited by 17
  28. 2024UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Constructioncited by 15
  29. 2025Knowledge Graph-based Retrieval-Augmented Generation for Schema Matchingcited by 13
  30. 2024KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Modelscited by 12
  31. 2022Endowing Language Models with Multimodal Knowledge Graph Representationscited by 11
  32. 2025AGENTiGraph: A Multi-Agent Knowledge Graph Framework for Interactive, Domain-Specific LLM Chatbotscited by 10
  33. 2023TransfQMix: Transformers for Leveraging the Graph Structure of Multi-Agent Reinforcement Learning Problemscited by 9
  34. 2024Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question Answeringcited by 9
  35. 2024ODA: Observation-Driven Agent for integrating LLMs and Knowledge Graphscited by 8
  36. 2023Towards Foundation Models for Relational Databases [Vision Paper]cited by 6
  37. 2025Multi-Agent GraphRAG: A Text-to-Cypher Framework for Labeled Property Graphscited by 5
  38. 2025MA-GTS: A Multi-Agent Framework for Solving Complex Graph Problems in Real-World Applicationscited by 3

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Are Large Language Models Suitable for Graph Computation? Progress and Prospects
  2. 2025Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigation
  3. 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrieval
  4. 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Model
  5. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities
  6. 2025Actions Speak Louder than Prompts: A Large-Scale Study of LLMs for Graph Inference
  7. 2024GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration
  8. 2024Can LLMs perform structured graph reasoning?