Extractive Summarization of Legal Decisions using Multi-task Learning and Maximal Marginal Relevance
Not on the map. Why?
Abstract (arXiv)
Summarizing legal decisions requires the expertise of law practitioners, which is both time- and cost-intensive. This paper presents techniques for extractive summarization of legal decisions in a low-resource setting using limited expert annotated data. We test a set of models that locate relevant content using a sequential model and tackle redundancy by leveraging maximal marginal relevance to compose summaries. We also demonstrate an implicit approach to help train our proposed models generate more informative summaries. Our multi-task learning model variant leverages rhetorical role identification as an auxiliary task to further improve the summarizer. We perform extensive experiments on datasets containing legal decisions from the US Board of Veterans' Appeals and conduct quantitative and expert-ranked evaluations of our models. Our results show that the proposed approaches can achieve ROUGE scores vis-`a-vis expert extracted summaries that match those achieved by inter-annotator comparison.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 22 Oct 2022.
Builds on
14 of 35 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2018CatBoost: gradient boosting with categorical features supportcited by 208
- 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 199
- 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
- 2019Identification of Rhetorical Roles of Sentences in Indian Legal Judgmentscited by 39
- 2016Variations of the Similarity Function of TextRank for Automated Summarizationcited by 27
- 2021Incorporating Domain Knowledge for Extractive Summarization of Legal Case Documentscited by 23
- 2020Systematically Exploring Redundancy Reduction in Summarizing Long Documentscited by 21
- 2021Context-Aware Legal Citation Recommendation using Deep Learningcited by 12
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 4; 2025: 1; 2026: 1.
9 papers.
- 2023How Ready are Pre-trained Abstractive Models and LLMs for Legal Case Judgement Summarization?cited by 43
- 2023Towards Argument-Aware Abstractive Summarization of Long Legal Opinions with Summary Rerankingcited by 9
- 2024LexAbSumm: Aspect-based Summarization of Legal Decisionscited by 9
- 2024Beyond Borders: Investigating Cross-Jurisdiction Transfer in Legal Case Summarizationcited by 8
- 2024Better RAG using Relevant Information Gaincited by 7
- 2024LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in Englishcited by 7
- 2022What to Read in a Contract? Party-Specific Summarization of Legal Obligations, Entitlements, and Prohibitionscited by 5
- 2025CoPERLex: Content Planning with Event-based Representations for Legal Case Summarizationcited by 4
- 2026LP-Eval: Rubric and Dataset for Measuring the Quality of Legal Proposition Generationcited by 0
- 2026LP-Eval: Rubric and Dataset for Measuring the Quality of Legal Proposition Generation19 May 2026
- 2025CoPERLex: Content Planning with Event-based Representations for Legal Case Summarization23 Jan 2025
- 2024LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in English12 Oct 2024
- 2024Better RAG using Relevant Information Gain16 Jul 2024
- 2024LexAbSumm: Aspect-based Summarization of Legal Decisions31 Mar 2024
- 2024Beyond Borders: Investigating Cross-Jurisdiction Transfer in Legal Case Summarization28 Mar 2024
- 2023How Ready are Pre-trained Abstractive Models and LLMs for Legal Case Judgement Summarization?2 Jun 2023
- 2023Towards Argument-Aware Abstractive Summarization of Long Legal Opinions with Summary Reranking1 Jun 2023
- 2022What to Read in a Contract? Party-Specific Summarization of Legal Obligations, Entitlements, and Prohibitions19 Dec 2022