mlsanityData to 14 Oct 2026

SemEval 2023 Task 6: LegalEval - Understanding Legal Texts

arXiv 2304.09548 ↗First posted 19 Apr 2023cs.CL cs.AI cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

In populous countries, pending legal cases have been growing exponentially. There is a need for developing NLP-based techniques for processing and automatically understanding legal documents. To promote research in the area of Legal NLP we organized the shared task LegalEval - Understanding Legal Texts at SemEval 2023. LegalEval task has three sub-tasks: Task-A (Rhetorical Roles Labeling) is about automatically structuring legal documents into semantically coherent units, Task-B (Legal Named Entity Recognition) deals with identifying relevant entities in a legal document and Task-C (Court Judgement Prediction with Explanation) explores the possibility of automatically predicting the outcome of a legal case along with providing an explanation for the prediction. In total 26 teams (approx. 100 participants spread across the world) submitted systems paper. In each of the sub-tasks, the proposed systems outperformed the baselines; however, there is a lot of scope for improvement. This paper describes the tasks, and analyzes techniques proposed by various teams.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 26 of its 68 references that are in the map. First posted on arXiv 19 Apr 2023.

Builds on

26 of 68 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2017Graph Attention Networkscited by 8,923
  5. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  6. 2020Longformer: The Long-Document Transformercited by 3,413
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  10. 2018Universal Sentence Encodercited by 489
  11. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  12. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
14 more
  1. 2019Neural Legal Judgment Prediction in Englishcited by 209
  2. 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
  3. 2021ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanationcited by 78
  4. 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
  5. 2019Legal Judgment Prediction via Multi-Perspective Bi-Feedback Networkcited by 50
  6. 2019Identification of Rhetorical Roles of Sentences in Indian Legal Judgmentscited by 39
  7. 2019Charge-Based Prison Term Prediction with Deep Gating Networkcited by 31
  8. 2021Semantic Segmentation of Legal Documents via Rhetorical Rolescited by 26
  9. 2022Named Entity Recognition in Indian court judgmentscited by 26
  10. 2022Corpus for Automatic Structuring of Legal Documentscited by 25
  11. 2020Building Legal Case Retrieval Systems with Lexical Matching and Summarization using A Pre-Trained Phrase Scoring Modelcited by 24
  12. 2018Automatic Judgment Prediction via Legal Reading Comprehensioncited by 19
  13. 2022HLDC: Hindi Legal Documents Corpuscited by 11
  14. 2022Data-Centric Machine Learning in the Legal Domaincited by 2

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 3; 2025: 1.

7 papers.

  1. 2024Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courtscited by 15
  2. 2023Nonet at SemEval-2023 Task 6: Methodologies for Legal Evaluationcited by 9
  3. 2023Harnessing GPT-3.5-turbo for Rhetorical Role Prediction in Legal Casescited by 8
  4. 2025LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classificationcited by 8
  5. 2024Bonafide at LegalLens 2024 Shared Task: Using Lightweight DeBERTa Based Encoder For Legal Violation Detection and Resolutioncited by 1
  6. 2023Rhetorical Role Labeling of Legal Documents using Transformers and Graph Neural Networkscited by 0
  7. 2024BayesJudge: Bayesian Kernel Language Modelling with Confidence Uncertainty in Legal Judgment Predictioncited by 0