LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 2 more
Abstract (arXiv)
Graph-based Retrieval-Augmented Generation (GraphRAG) advances flat document retrieval by structuring knowledge as relational graphs, enabling more coherent and effective reasoning. However, applying it to specific domains like legal reasoning faces critical challenges. (i) Legal corpora are heterogeneous, containing multi-granular knowledge from cases, articles and interpretations. A flat knowledge graph cannot adequately differentiate between factual details, applied rules, and abstract principles, limiting accurate retrieval. (ii) Reliable legal judgment demands transparent, evidence-based reasoning. Traditional RAG passes retrieved context directly to an LLM without verification, resulting in opaque, error-prone reasoning. To this end, we propose LegalGraphRAG, a framework designed for reliable legal reasoning. Our approach introduces two core components: a hierarchical legal graph that hierarchically organizes legal sources to enable retrieval at appropriate abstraction levels, and a multi-agent system for reliable legal reasoning, where a Researcher retrieves candidate evidence, an Auditor rigorously verifies its validity against source documents, and an Adjudicator synthesizes the set of verified evidence to render a final judgment. Extensive experiments show that LegalGraphRAG achieves the state-of-the-art performance, outperforming existing GraphRAG baselines in accurate and trustworthy legal analysis. Our code, datasets and implementation details are available at https://github.com/XMUDeepLIT/LegalGraphRAG.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 38 of its 76 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
38 of 76 references.
Closest ancestors · 4
Same direction, newest first
- 2025GLARE: Agentic Reasoning for Legal Judgment Prediction22 Aug
- 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gain17 Aug
- 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems12 Apr
- 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction2 Jul
Other references · 34
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023A Survey of Large Language Modelscited by 2,576
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
22 more
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 170
- 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 142
- 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 122
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 118
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
- 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
- 2022Legal Prompting: Teaching a Language Model to Think Like a Lawyercited by 60
- 2023Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaborationcited by 52
- 2025When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generationcited by 48
- 2024LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Modelcited by 34
- 2017Exploring the Use of Text Classification in the Legal Domaincited by 31
- 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 25
- 2024Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulationcited by 15
- 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
- 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networkscited by 9
- 2024CaseGPT: a case reasoning framework based on language models and retrieval-augmented generationcited by 7
- 2025Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair Usecited by 6
- 2025Rethinking Retrieval-Augmented Generation for Medicine: A Large-Scale, Systematic Expert Evaluation and Practical Insightscited by 6
- 2025An Ontology-Driven Graph RAG for Legal Norms: A Structural, Temporal, and Deterministic Approachcited by 3
- 2024Should We Fear Large Language Models? A Structural Analysis of the Human Reasoning System for Elucidating LLM Capabilities and Risks Through the Lens of Heidegger's Philosophycited by 2
- 2024Athena: Retrieval-augmented Legal Judgment Prediction with Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026MemSyco-Bench: Benchmarking Sycophancy in Agent Memorycited by 12
- 2026HVM-GraphRAG: Holistic-View Multimodal Graph Retrieval-Augmented Generation on Complex Documentcited by 1
- 2026LEGO: Synergizing Expert GraphRAG and Expert Chain-of-Thought for Legal Reasoningcited by 0
- 2026LabourCrew: A Multi-Agent RAG Framework for Trustworthy Adversarial Deliberation and Statutory Reasoning over Labour Lawcited by 0
- 2026ARGUS: Role-Aware Event Knowledge Graphs for U.S. Employment-Discrimination Complaintscited by 0
- 2026ARGUS: Role-Aware Event Knowledge Graphs for U.S. Employment-Discrimination Complaints24 Sep 2026
- 2026LEGO: Synergizing Expert GraphRAG and Expert Chain-of-Thought for Legal Reasoning22 Sep 2026
- 2026LabourCrew: A Multi-Agent RAG Framework for Trustworthy Adversarial Deliberation and Statutory Reasoning over Labour Law18 Aug 2026
- 2026HVM-GraphRAG: Holistic-View Multimodal Graph Retrieval-Augmented Generation on Complex Document26 Jul 2026
- 2026MemSyco-Bench: Benchmarking Sycophancy in Agent Memory1 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Deterministic Legal Agents: A Canonical Primitive API for Auditable Reasoning over Temporal Knowledge Graphs
- 2026Verifiable Retrieval for Legal Reasoning through Structure-driven Knowledge Graph
- 2026Falkor-IRAC: Graph-Constrained Generation for Verified Legal Reasoning in Indian Judicial AI
- 2025Domain-Partitioned Hybrid RAG for Legal Reasoning: Toward Modular and Explainable Legal AI for India
- 2026Legal-R1: Agentic Retrieval for Evidence-Based Legal Reasoning
- 2025A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences
- 2025Capturing Legal Reasoning Paths from Facts to Law in Court Judgments using Knowledge Graphs
- 2025Bridging Legal Knowledge and AI: Retrieval-Augmented Generation with Vector Stores, Knowledge Graphs, and Hierarchical Non-negative Matrix Factorization