LAURA: Knowledge Distillation for Interpretable Ambiguous Clause Identification in Legal Contracts
New in Knowledge distillation; no direction yet. Knowledge distillation
Abstract (arXiv)
Legal contracts contain ambiguities that expose enterprises to financial and legal risks. Some ambiguities allow flexible interpretation without triggering disputes, while others lead to significant legal conflicts. This makes identification alone insufficient, and interpretable rationale analysis essential. We propose LAURA, a post-training framework for interpretable ambiguous clause identification. LAURA leverages knowledge distillation with an IRAC-Unlearning prompting technique to transfer knowledge from a teacher LLM to an open-weight student model (<=1B parameters), which is then trained using a joint objective combining classification and rationale generation losses. The framework supports both legal and non-legal stakeholders in making informed decisions about which ambiguities require further attention. Extensive experiments across 7 baselines and 7 open-weight models demonstrate that LAURA with Flan-T5 (250M) delivers state-of-the-art interpretability over all interpretable baselines while matching the identification performance of the best-performing opaque baseline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
16 of 32 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 240
- 2024A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthinesscited by 127
- 2024Small Language Models: Survey, Measurements, and Insightscited by 112
- 2025A Comprehensive Survey on Knowledge Distillationcited by 51
- 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correctioncited by 42
- 2025LexTime: A Benchmark for Temporal Ordering of Legal Eventscited by 10
4 more
- 2025A Survey of Classification Tasks and Approaches for Legal Contractscited by 6
- 2022ConReader: Exploring Implicit Relations in Contracts for Contract Clause Extractioncited by 5
- 2025Evaluating Customized vs. Generalist Transformer-based Models for Legal Contract Classificationcited by 2
- 2024Generating Clarification Questions for Disambiguating Contractscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Better Call CLAUSE: A Discrepancy Benchmark for Auditing LLMs Legal Reasoning Capabilities
- 2025ContractEval: Benchmarking LLMs for Clause-Level Legal Risk Identification in Commercial Contracts
- 2026ContractScrub: A benchmark for final review of legal contracts
- 2024Automating IRAC Analysis in Malaysian Contract Law using a Semi-Structured Knowledge Base
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
- 2026ContraVis: Evidence-Grounded Visual Analytics for Contradiction Review in Legal Contracts
- 2025Metadata Extraction Leveraging Large Language Models
- 2025Towards Robust Legal Reasoning: Harnessing Logical LLMs in Law