mlsanityData to 14 Oct 2026

LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning

arXiv 2605.28120 ↗First posted 27 May 2026cs.CL cs.AI cs.MAcited by 5

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 2 more
Abstract (arXiv)

Graph-based Retrieval-Augmented Generation (GraphRAG) advances flat document retrieval by structuring knowledge as relational graphs, enabling more coherent and effective reasoning. However, applying it to specific domains like legal reasoning faces critical challenges. (i) Legal corpora are heterogeneous, containing multi-granular knowledge from cases, articles and interpretations. A flat knowledge graph cannot adequately differentiate between factual details, applied rules, and abstract principles, limiting accurate retrieval. (ii) Reliable legal judgment demands transparent, evidence-based reasoning. Traditional RAG passes retrieved context directly to an LLM without verification, resulting in opaque, error-prone reasoning. To this end, we propose LegalGraphRAG, a framework designed for reliable legal reasoning. Our approach introduces two core components: a hierarchical legal graph that hierarchically organizes legal sources to enable retrieval at appropriate abstraction levels, and a multi-agent system for reliable legal reasoning, where a Researcher retrieves candidate evidence, an Auditor rigorously verifies its validity against source documents, and an Adjudicator synthesizes the set of verified evidence to render a final judgment. Extensive experiments show that LegalGraphRAG achieves the state-of-the-art performance, outperforming existing GraphRAG baselines in accurate and trustworthy legal analysis. Our code, datasets and implementation details are available at https://github.com/XMUDeepLIT/LegalGraphRAG.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 38 of its 76 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

38 of 76 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025GLARE: Agentic Reasoning for Legal Judgment Prediction22 Aug
  2. 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gain17 Aug
  3. 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems12 Apr
  4. 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction2 Jul

Other references · 34

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023A Survey of Large Language Modelscited by 2,576
  5. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  6. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  7. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  8. 2024DeepSeek-V3 Technical Reportcited by 811
  9. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
  10. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  11. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
  12. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
22 more
  1. 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 170
  2. 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 142
  3. 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 122
  4. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
  5. 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 118
  6. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
  7. 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
  8. 2022Legal Prompting: Teaching a Language Model to Think Like a Lawyercited by 60
  9. 2023Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaborationcited by 52
  10. 2025When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generationcited by 48
  11. 2024LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Modelcited by 34
  12. 2017Exploring the Use of Text Classification in the Legal Domaincited by 31
  13. 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 25
  14. 2024Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulationcited by 15
  15. 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
  16. 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networkscited by 9
  17. 2024CaseGPT: a case reasoning framework based on language models and retrieval-augmented generationcited by 7
  18. 2025Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair Usecited by 6
  19. 2025Rethinking Retrieval-Augmented Generation for Medicine: A Large-Scale, Systematic Expert Evaluation and Practical Insightscited by 6
  20. 2025An Ontology-Driven Graph RAG for Legal Norms: A Structural, Temporal, and Deterministic Approachcited by 3
  21. 2024Should We Fear Large Language Models? A Structural Analysis of the Human Reasoning System for Elucidating LLM Capabilities and Risks Through the Lens of Heidegger's Philosophycited by 2
  22. 2024Athena: Retrieval-augmented Legal Judgment Prediction with Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Deterministic Legal Agents: A Canonical Primitive API for Auditable Reasoning over Temporal Knowledge Graphs
  2. 2026Verifiable Retrieval for Legal Reasoning through Structure-driven Knowledge Graph
  3. 2026Falkor-IRAC: Graph-Constrained Generation for Verified Legal Reasoning in Indian Judicial AI
  4. 2025Domain-Partitioned Hybrid RAG for Legal Reasoning: Toward Modular and Explainable Legal AI for India
  5. 2026Legal-R1: Agentic Retrieval for Evidence-Based Legal Reasoning
  6. 2025A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences
  7. 2025Capturing Legal Reasoning Paths from Facts to Law in Court Judgments using Knowledge Graphs
  8. 2025Bridging Legal Knowledge and AI: Retrieval-Augmented Generation with Vector Stores, Knowledge Graphs, and Hierarchical Non-negative Matrix Factorization