Nonet at SemEval-2023 Task 6: Methodologies for Legal Evaluation
Not on the map. Why?
Abstract (arXiv)
This paper describes our submission to the SemEval-2023 for Task 6 on LegalEval: Understanding Legal Texts. Our submission concentrated on three subtasks: Legal Named Entity Recognition (L-NER) for Task-B, Legal Judgment Prediction (LJP) for Task-C1, and Court Judgment Prediction with Explanation (CJPE) for Task-C2. We conducted various experiments on these subtasks and presented the results in detail, including data statistics and methodology. It is worth noting that legal tasks, such as those tackled in this research, have been gaining importance due to the increasing need to automate legal analysis and support. Our team obtained competitive rankings of 15th, 11th, and 1st in Task-B, Task-C1, and Task-C2, respectively, as reported on the leaderboard.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 17 Oct 2023.
Builds on
15 of 21 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019Neural Legal Judgment Prediction in Englishcited by 208
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
- 2021ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanationcited by 78
- 2019Identification of Rhetorical Roles of Sentences in Indian Legal Judgmentscited by 39
- 2022Named Entity Recognition in Indian court judgmentscited by 26
- 2022Explainable Information Retrieval: A Surveycited by 15
3 more
- 2022HLDC: Hindi Legal Documents Corpuscited by 11
- 2023SemEval 2023 Task 6: LegalEval - Understanding Legal Textscited by 7
- 2020Named Entity Recognition in the Legal Domain using a Pointer Generator Networkcited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 1; 2026: 1.
9 papers.
- 2024Applicability of Large Language Models and Generative Models for Legal Case Judgement Summarizationcited by 23
- 2024Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Modelscited by 10
- 2025LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classificationcited by 8
- 2023Questioning Biases in Case Judgment Summaries: Legal Datasets or Large Language Models?cited by 7
- 2024Code Generation and Algorithmic Problem Solving Using Llama 3.1 405Bcited by 7
- 2024MIRROR: A Novel Approach for the Automated Evaluation of Open-Ended Question Generationcited by 6
- 2024Prompt Engineering Using GPT for Word-Level Code-Mixed Language Identification in Low-Resource Dravidian Languagescited by 2
- 2024CryptoLLM: Unleashing the Power of Prompted LLMs for SmartQnA and Classification of Crypto Postscited by 0
- 2026AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal Systemcited by 0
- 2026AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal System21 Jul 2026
- 2025LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classification9 Feb 2025
- 2024CryptoLLM: Unleashing the Power of Prompted LLMs for SmartQnA and Classification of Crypto Posts12 Nov 2024
- 2024Prompt Engineering Using GPT for Word-Level Code-Mixed Language Identification in Low-Resource Dravidian Languages6 Nov 2024
- 2024MIRROR: A Novel Approach for the Automated Evaluation of Open-Ended Question Generation16 Oct 2024
- 2024Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Models14 Oct 2024
- 2024Code Generation and Algorithmic Problem Solving Using Llama 3.1 405B26 Sep 2024
- 2024Applicability of Large Language Models and Generative Models for Legal Case Judgement Summarization6 Jul 2024
- 2023Questioning Biases in Case Judgment Summaries: Legal Datasets or Large Language Models?1 Dec 2023