mlsanityData to 7 Oct 2026

Extractive Summarization of Legal Decisions using Multi-task Learning and Maximal Marginal Relevance

arXiv 2210.12437 ↗First posted 22 Oct 2022cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Summarizing legal decisions requires the expertise of law practitioners, which is both time- and cost-intensive. This paper presents techniques for extractive summarization of legal decisions in a low-resource setting using limited expert annotated data. We test a set of models that locate relevant content using a sequential model and tackle redundancy by leveraging maximal marginal relevance to compose summaries. We also demonstrate an implicit approach to help train our proposed models generate more informative summaries. Our multi-task learning model variant leverages rhetorical role identification as an auxiliary task to further improve the summarizer. We perform extensive experiments on datasets containing legal decisions from the US Board of Veterans' Appeals and conduct quantitative and expert-ranked evaluations of our models. Our results show that the proposed approaches can achieve ROUGE scores vis-`a-vis expert extracted summaries that match those achieved by inter-annotator comparison.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 22 Oct 2022.

Builds on

14 of 35 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
  5. 2018CatBoost: gradient boosting with categorical features supportcited by 208
  6. 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 199
  7. 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
  8. 2019Identification of Rhetorical Roles of Sentences in Indian Legal Judgmentscited by 39
  9. 2016Variations of the Similarity Function of TextRank for Automated Summarizationcited by 27
  10. 2021Incorporating Domain Knowledge for Extractive Summarization of Legal Case Documentscited by 23
  11. 2020Systematically Exploring Redundancy Reduction in Summarizing Long Documentscited by 21
  12. 2021Context-Aware Legal Citation Recommendation using Deep Learningcited by 12
2 more
  1. 2021Lex Rosetta: Transfer of Predictive Models Across Languages, Jurisdictions, and Legal Domainscited by 11
  2. 2018Multi-Task Deep Learning for Legal Document Translation, Summarization and Multi-Label Classificationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 4; 2025: 1; 2026: 1.

9 papers.