mlsanityData to 14 Oct 2026

LEGO: Synergizing Expert GraphRAG and Expert Chain-of-Thought for Legal Reasoning

arXiv 2609.27009 ↗First posted 22 Sep 2026cs.CL cs.IRcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Large language models are increasingly applied to high-risk domains such as law, yet complex legal reasoning remains limited by two structural challenges. First, existing RAG and GraphRAG methods emphasize lexical or semantic similarity while overlooking normative relations among legal provisions. Second, vanilla Chain-of-Thought prompting may generate plausible rationales without enforcing the normative structure of legal reasoning. To deal with the bottleneck of pipelines in the legal reasoning domain, we propose LEGO, a dual-module framework that synergizes Legal Expert GraphRAG and expert Chain-of-thought for complex legal reasoning. ExpertGraphRAG uses an expert-annotated civil code graph encoding these normative relations with a greedy normative-coverage retrieval algorithm to dynamically extract instance-specific provision subgraphs, while ExpertCoT organizes the retrieved provisions and case facts into structured Provision-Fact-Conclusion reasoning. With a Qwen3-8B backbone, LEGO achieves 40.53% exact-match accuracy on LawExamQA_Civil, outperforming the evaluated RAG and CoT baselines and performing comparably to the evaluated larger models, while remaining robust on multi-hop questions. It also achieves the best results among the evaluated baselines on the open-ended benchmarks. Ablation studies confirm the individual and complementary contributions of both modules, demonstrating LEGO's effectiveness in improving LLMs' complex legal reasoning ability. Code and dataset can be found in the link: https://github.com/BLK-WHT/LEGO

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 33 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

26 of 33 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025What Breaks Knowledge Graph based RAG? Benchmarking and Empirical Insights into Reasoning under Incomplete Knowledge11 Aug
  2. 2025You Don't Need Pre-built Graphs for RAG: Retrieval Augmented Generation with Adaptive Reasoning Structures8 Aug
  3. 2024RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation8 Mar
  4. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec

Other references · 22

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  4. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  5. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  6. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  7. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  8. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 310
  9. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 265
  10. 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 122
  11. 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 116
  12. 2023Can GPT-3 Perform Statutory Reasoning?cited by 73
10 more
  1. 2025RAG vs. GraphRAG: A Systematic Evaluation and Key Insightscited by 53
  2. 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversationcited by 19
  3. 2023Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer?cited by 12
  4. 2025J&H: Evaluating the Robustness of Large Language Models Under Knowledge-Injection Attacks in Legal Domaincited by 7
  5. 2025KoBLEX: Open Legal Question Answering with Multi-hop Reasoningcited by 7
  6. 2025JUREX-4E: Juridical Expert-Annotated Four-Element Knowledge Base for Legal Reasoningcited by 5
  7. 2025Expert-Guided Prompting and Retrieval-Augmented Generation for Emergency Medical Service Question Answeringcited by 5
  8. 2026LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoningcited by 5
  9. 2025PankRAG: Enhancing Graph Retrieval via Globally Aware Query Resolution and Dependency-Aware Reranking Mechanismcited by 3
  10. 2026OMD-GraphRAG: Enhancing GraphRAG with Ontology-Guided Extraction, Multi-Dimensional Clustering and Dual-Channel Fusioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OpenExempt: A Diagnostic Benchmark for Legal Reasoning and a Framework for Creating Custom Benchmarks on Demand
  2. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
  3. 2025A Reasoning-Focused Legal Retrieval Benchmark
  4. 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Models
  5. 2025Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning
  6. 2025Evaluating Test-Time Scaling LLMs for Legal Reasoning: OpenAI o1, DeepSeek-R1, and Beyond
  7. 2022The Legal Argument Reasoning Task in Civil Procedure
  8. 2025Domain-Partitioned Hybrid RAG for Legal Reasoning: Toward Modular and Explainable Legal AI for India