mlsanityData to 7 Oct 2026

Graph-R1: Towards Agentic GraphRAG Framework via End-to-end Reinforcement Learning

arXiv 2507.21892 ↗First posted 29 Jul 2025cs.CLcited by 50

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

also in 1 more
Abstract (arXiv)

Retrieval-Augmented Generation (RAG) mitigates hallucination in LLMs by incorporating external knowledge, but relies on chunk-based retrieval that lacks structural semantics. GraphRAG methods improve RAG by modeling knowledge as entity-relation graphs, but still face challenges in high construction cost, fixed one-time retrieval, and reliance on long-context reasoning and prompt design. To address these challenges, we propose Graph-R1, the first agentic GraphRAG framework via end-to-end reinforcement learning (RL). It introduces lightweight knowledge hypergraph construction, models retrieval as a multi-turn agent-environment interaction, and optimizes the agent process via an end-to-end reward mechanism. Experiments on standard RAG datasets show that Graph-R1 outperforms traditional GraphRAG and RL-enhanced RAG methods in reasoning accuracy, retrieval efficiency, and generation quality. Our software and data are publicly available at https://github.com/LHRLAB/Graph-R1.

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 40 of its 61 references that are in the map. First posted on arXiv 29 Jul 2025.

Builds on

40 of 61 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025GraphRAG-Bench: Challenging Domain-Specific Reasoning for Evaluating Graph Retrieval-Augmented Generation3 Jun
  2. 2025PropRAG: Guiding Retrieval with Beam Search over Proposition Paths25 Apr
  3. 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodes15 Apr
  4. 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representation27 Mar
  5. 2025CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation25 Mar
  6. 2025PathRAG: Pruning Graph-based Retrieval Augmented Generation with Relational Paths18 Feb
  7. 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation3 Feb
  8. 2024KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation10 Sep
  9. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr

Other references · 31

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  7. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  8. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  9. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  10. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  11. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  12. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
19 more
  1. 2023Large Language Modelscited by 774
  2. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  3. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
  4. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
  5. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 322
  6. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
  7. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 233
  8. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
  9. 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 203
  10. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  11. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 166
  12. 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
  13. 2024Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generationcited by 89
  14. 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 67
  15. 2025Synergizing RAG and Reasoning: A Systematic Reviewcited by 27
  16. 2024HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Basescited by 26
  17. 2025Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generationcited by 23
  18. 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Searchcited by 21
  19. 2023Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Constructioncited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 16; 2026: 34.

50 papers.

Sort:

By area:

  1. 2025Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecyclecited by 34
  2. 2025Think-on-Graph 3.0: Efficient and Adaptive LLM Reasoning on Heterogeneous Graphs via Multi-Agent Dual-Evolving Context Retrievalcited by 10
  3. 2025WebGraphEval: Multi-Turn Trajectory Evaluation for Web Agents using Graph Representationcited by 7
  4. 2025Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement Learningcited by 7
  5. 2025TeaRAG: A Token-Efficient Agentic Retrieval-Augmented Generation Frameworkcited by 7
  6. 2025AutoGraph-R1: End-to-End Reinforcement Learning for Knowledge Graph Constructioncited by 6
  7. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphscited by 5
  8. 2025Structure-R1: Dynamically Leveraging Structural Knowledge in LLM Reasoning through Reinforcement Learningcited by 5
  9. 2026DLLM Agent: See Farther, Run Fastercited by 5
  10. 2026MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Searchcited by 4
  11. 2025KnowCoder-A1: Incentivizing Agentic Reasoning Capability with Outcome Supervision for KBQAcited by 3
  12. 2025LexGenius: An Expert-Level Benchmark for Large Language Models in Legal General Intelligencecited by 3
38 more
  1. 2025KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answeringcited by 3
  2. 2026HyperGraphPro: Progress-Aware Reinforcement Learning for Structure-Guided Hypergraph RAGcited by 3
  3. 2026Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirerscited by 3
  4. 2026S-Path-RAG: Semantic-Aware Shortest-Path Retrieval Augmented Generation for Multi-Hop Knowledge Graph Question Answeringcited by 3
  5. 2025From Evidence to Trajectory: Abductive Reasoning Path Synthesis for Retrieval-Augmented Generation Agents Developmentcited by 2
  6. 2026SCOUT-RAG: Scalable and Cost-Efficient Unifying Traversal for Agentic Graph-RAG over Distributed Domainscited by 2
  7. 2026EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrievalcited by 2
  8. 2026Search-on-Graph-R1: Training Large Language Models to Search Knowledge Graphs with Reinforcement Learningcited by 2
  9. 2025Agentic-KGR: Co-evolutionary Knowledge Graph Construction through Multi-Agent Reinforcement Learningcited by 1
  10. 2025Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge Graphscited by 1
  11. 2025Multi-hop Reasoning via Early Knowledge Alignmentcited by 1
  12. 2026GraphDancer: Training LLMs to Explore and Reason over Graphs via Two-Stage Curriculum Post-Trainingcited by 1
  13. 2026GraphScout: Empowering Large Language Models with Intrinsic Exploration Ability for Agentic Graph Reasoningcited by 1
  14. 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Modelscited by 1
  15. 2026An Alternative Trajectory for Generative AIcited by 1
  16. 2026Do We Still Need GraphRAG? Benchmarking RAG and GraphRAG for Agentic Search Systemscited by 1
  17. 2026GraphRAG-Router: Learning Cost-Efficient Routing over GraphRAGs and LLMs with Reinforcement Learningcited by 1
  18. 2026AdaptR1: Reinforcement Learning Based Adaptive Interleaved Thinking in Multi-hop Question Answeringcited by 1
  19. 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedgescited by 1
  20. 2025Beyond Static Retrieval: Opportunities and Pitfalls of Iterative Retrieval in GraphRAGcited by 0
  21. 2026Token-Guard: Towards Token-Level Hallucination Control via Self-Checking Decodingcited by 0
  22. 2026AtomicRAG: Atom-Entity Graphs for Retrieval-Augmented Generationcited by 0
  23. 2026DeepRefine: Agentic Knowledge Refinement via Reinforcement Learningcited by 0
  24. 2026RAGA: Reading-And-Graph-building-Agent for Autonomous Knowledge Graph Construction and Retrieval-Augmented Generationcited by 0
  25. 2026SeedER: Seed-Expand-Retrieve for Efficient Knowledge Graph Retrievalcited by 0
  26. 2026Can Hallucinations Be Useful? Solving Multi-Hop Questions With SLMs By Chaining System-I/II Reasoningcited by 0
  27. 2026PathRouter: Aligning Rewards with Retrieval Quality in Agentic Graph Retrieval-Augmented Generationcited by 0
  28. 2026Memory-Orchestrated Semantic System (MOSS): An Auditable Agentic Memory Architecturecited by 0
  29. 2026HyGRL: Adaptive Hybrid Graph Reasoning for Multi-Entity Questionscited by 0
  30. 2026Harness-G: A Graph-Structured Harness for Search Agentscited by 0
  31. 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedgescited by 0
  32. 2026EviReform: Evidence-Guided Query Reformulation for Multi-Hop Graph Retrievalcited by 0
  33. 2026GTA-RAG: Graph-Trajectory-Augmented Reinforcement Learning for Multi-Turn Retrieval-Augmented Reasoningcited by 0
  34. 2026Building Trustworthy Graph-Agentic RAG for Social Good: Architectures, Failure Propagation, and Assurance by Constructioncited by 0
  35. 2026Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergycited by 0
  36. 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systemscited by 0
  37. 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learningcited by 0
  38. 2026GraphCert: Bootstrap Agentic Graph Reasoning with Certified Evidence Rubricscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning
  2. 2026AgenticRag-R1: Agentic Reinforcement Learning with Stack Memory for Multi-Step Reasoning, Retrieval and Memorizing
  3. 2025GraphRAG-R1: Graph Retrieval-Augmented Generation with Process-Constrained Reinforcement Learning
  4. 2025RouteRAG: Efficient Retrieval-Augmented Generation from Text and Graph via Reinforcement Learning
  5. 2026TreePS-RAG: Tree-based Process Supervision for Reinforcement Learning in Agentic RAG
  6. 2025HiPRAG: Hierarchical Process Rewards for Efficient Agentic Retrieval Augmented Generation
  7. 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applications
  8. 2025GraphSearch: An Agentic Deep Searching Workflow for Graph Retrieval-Augmented Generation