LAMUS: A Large-Scale Corpus for Legal Argument Mining from U.S. Caselaw using LLMs
Not on the map. Why?
Abstract (arXiv)
Legal argument mining aims to identify and classify the functional components of judicial reasoning, such as facts, issues, rules, analysis, and conclusions. Progress in this area is limited by the lack of large-scale, high-quality annotated datasets for U.S. caselaw, particularly at the state level. This paper introduces LAMUS, a sentence-level legal argument mining corpus constructed from U.S. Supreme Court decisions and Texas criminal appellate opinions. The dataset is created using a data-centric pipeline that combines large-scale case collection, LLM-based automatic annotation, and targeted human-in-the-loop quality refinement. We formulate legal argument mining as a six-class sentence classification task and evaluate multiple general-purpose and legal-domain language models under zero-shot, few-shot, and chain-of-thought prompting strategies, with LegalBERT as a supervised baseline. Results show that chain-of-thought prompting substantially improves LLM performance, while domain-specific models exhibit more stable zero-shot behavior. LLM-assisted verification corrects nearly 20% of annotation errors, improving label consistency. Human verification achieves Cohen's Kappa of 0.85, confirming annotation quality. LAMUS provides a scalable resource and empirical insights for future legal NLP research. All code and datasets can be accessed for reproducibility on GitHub at: https://github.com/LavanyaPobbathi/LAMUS/tree/main
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
18 of 36 references.
References · 18
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2023Data-centric Artificial Intelligence: A Surveycited by 202
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
- 2024LegalAgentBench: Evaluating LLM Agents in Legal Domaincited by 56
- 2024Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challengescited by 42
- 2024SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domaincited by 39
- 2025Towards Robust Legal Reasoning: Harnessing Logical LLMs in Lawcited by 30
6 more
- 2018LexNLP: Natural language processing and information extraction for legal and regulatory textscited by 27
- 2024The Factuality of Large Language Models in the Legal Domaincited by 10
- 2025LeMAJ (Legal LLM-as-a-Judge): Bridging Legal Reasoning and LLM Evaluationcited by 9
- 2025Thinking Longer, Not Always Smarter: Evaluating LLM Capabilities in Hierarchical Legal Reasoningcited by 7
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governancecited by 3
- 2025Modeling Motivated Reasoning in Law: Evaluating Strategic Role Conditioning in LLM Summarizationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Models in Argument Mining: A Survey
- 2022The Legal Argument Reasoning Task in Civil Procedure
- 2025A comprehensive study of LLM-based argument classification: from LLAMA through GPT-4o to Deepseek-R1
- 2023Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement
- 2024On the Suitability of pre-trained foundational LLMs for Analysis in German Legal Education
- 2026Multi-Legal-Bench: Evaluating LLMs on Legal Reasoning Across Jurisdictions, Languages, and Legal Traditions
- 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Models
- 2026PROSLEX: A Novel Dataset for Expert-Annotated Legal Statute Prediction for Indian Judiciary