mlsanityData to 7 Oct 2026

Indian Legal NLP Benchmarks : A Survey

arXiv 2107.06056 ↗First posted 13 Jul 2021cs.CL cs.AI cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Availability of challenging benchmarks is the key to advancement of AI in a specific field.Since Legal Text is significantly different than normal English text, there is a need to create separate Natural Language Processing benchmarks for Indian Legal Text which are challenging and focus on tasks specific to Legal Systems. This will spur innovation in applications of Natural language Processing for Indian Legal Text and will benefit AI community and Legal fraternity. We review the existing work in this area and propose ideas to create new benchmarks for Indian Legal Natural Language Processing.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 13 Jul 2021.

Builds on

22 of 50 references.

References · 22

  1. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  3. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  4. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  5. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  6. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  7. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
  8. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  9. 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
  10. 2019Neural Legal Judgment Prediction in Englishcited by 208
  11. 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
  12. 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 128
10 more
  1. 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 115
  2. 2020GLGE: A New General Language Generation Evaluation Benchmarkcited by 47
  3. 2019Identification of Rhetorical Roles of Sentences in Indian Legal Judgmentscited by 39
  4. 2021ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generationcited by 31
  5. 2019CAIL2019-SCM: A Dataset of Similar Case Matching in Legal Domaincited by 30
  6. 2018ComQA: A Community-sourced Dataset for Complex Factoid Question Answering with Paraphrase Clusterscited by 29
  7. 2019CogCompTime: A Tool for Understanding Time in Natural Language Textcited by 23
  8. 2019Generating Question-Answer Hierarchiescited by 20
  9. 2016SelQA: A New Benchmark for Selection-based Question Answeringcited by 6
  10. 2017Bringing Structure into Summaries: Crowdsourcing a Benchmark Corpus of Concept Mapscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 0; 2026: 1.

3 papers.

  1. 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
  2. 2022Pre-trained Language Models for the Legal Domain: A Case Study on Indian Lawcited by 39
  3. 2026Can Legal AI Know When It Is Wrong? And Do Students Know When It Is?cited by 0