ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanation
Not on the map. Why?
Abstract (arXiv)
An automated system that could assist a judge in predicting the outcome of a case would help expedite the judicial process. For such a system to be practically useful, predictions by the system should be explainable. To promote research in developing such a system, we introduce ILDC (Indian Legal Documents Corpus). ILDC is a large corpus of 35k Indian Supreme Court cases annotated with original court decisions. A portion of the corpus (a separate test set) is annotated with gold standard explanations by legal experts. Based on ILDC, we propose the task of Court Judgment Prediction and Explanation (CJPE). The task requires an automated system to predict an explainable outcome of a case. We experiment with a battery of baseline models for case predictions and propose a hierarchical occlusion based model for explainability. Our best prediction model has an accuracy of 78% versus 94% for human legal experts, pointing towards the complexity of the prediction task. The analysis of explanations by the proposed algorithm reveals a significant difference in the point of view of the algorithm and legal experts for explaining the judgments, pointing towards scope for future research.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 28 May 2021.
Builds on
30 of 55 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2020Reformer: The Efficient Transformercited by 1,658
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
18 more
- 2019Attention is not Explanationcited by 916
- 2014Distributed Representations of Sentences and Documentscited by 677
- 2016Understanding Neural Networks through Representation Erasurecited by 223
- 2019Neural Legal Judgment Prediction in Englishcited by 208
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
- 2020Explainable Deep Learning: A Field Guide for the Uninitiatedcited by 127
- 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
- 2017Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Featurescited by 103
- 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
- 2017Learning to Predict Charges for Criminal Cases with Legal Basiscited by 61
- 2019Legal Judgment Prediction via Multi-Perspective Bi-Feedback Networkcited by 50
- 2019Identification of Rhetorical Roles of Sentences in Indian Legal Judgmentscited by 39
- 2018Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptionscited by 36
- 2019Charge-Based Prison Term Prediction with Deep Gating Networkcited by 31
- 2017Predicting the Law Area and Decisions of French Supreme Court Casescited by 30
- 2020Building Legal Case Retrieval Systems with Lexical Matching and Summarization using A Pre-Trained Phrase Scoring Modelcited by 24
- 2018Automatic Judgment Prediction via Legal Reading Comprehensioncited by 19
- 2019Topic Spotting using Hierarchical Networks with Self Attentioncited by 2
Built on by
Citing papers per year: 2021: 3; 2022: 11; 2023: 18; 2024: 19; 2025: 16; 2026: 11.
78 papers.
Sort:
By area:
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
- 2022Legal Prompt Engineering for Multilingual Legal Judgement Predictioncited by 54
- 2023LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Developmentcited by 54
- 2023Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaborationcited by 52
- 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
- 2022Pre-trained Language Models for the Legal Domain: A Case Study on Indian Lawcited by 39
- 2021Semantic Segmentation of Legal Documents via Rhetorical Rolescited by 26
- 2022Named Entity Recognition in Indian court judgmentscited by 26
- 2022Corpus for Automatic Structuring of Legal Documentscited by 25
- 2022Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformercited by 20
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
- 2023Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoningcited by 17
38 more
- 2022An Empirical Study on Cross-X Transfer for Legal Judgment Predictioncited by 16
- 2023U-CREAT: Unsupervised Case Retrieval using Events extrAcTioncited by 16
- 2021DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understandingcited by 15
- 2024Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courtscited by 15
- 2023Zero-shot Transfer of Article-aware Legal Outcome Classification for European Court of Human Rights Casescited by 14
- 2023From Dissonance to Insights: Dissecting Disagreements in Rationale Construction for Case Outcome Classificationcited by 14
- 2026Multimodal Multi-Agent Empowered Legal Judgment Predictioncited by 14
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and lawcited by 13
- 2023Leveraging Task Dependency and Contrastive Learning for Case Outcome Classification on European Court of Human Rights Casescited by 12
- 2022HLDC: Hindi Legal Documents Corpuscited by 11
- 2024ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Taskscited by 11
- 2023Fact-based Court Judgment Predictioncited by 10
- 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domaincited by 10
- 2023Nonet at SemEval-2023 Task 6: Methodologies for Legal Evaluationcited by 9
- 2024On Evaluating Explanation Utility for Human-AI Decision Making in NLPcited by 9
- 2025LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classificationcited by 8
- 2023SemEval 2023 Task 6: LegalEval - Understanding Legal Textscited by 7
- 2024Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Datasetcited by 7
- 2024PILOT: Legal Case Outcome Prediction with Case Lawcited by 6
- 2024The FIX Benchmark: Extracting Features Interpretable to eXpertscited by 5
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law Systemcited by 5
- 2025IL-PCSR: Legal Corpus for Prior Case and Statute Retrievalcited by 5
- 2024Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documentscited by 4
- 2024Towards Explainability in Legal Outcome Prediction Modelscited by 4
- 2024Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Casescited by 4
- 2022Creation and Analysis of an International Corpus of Privacy Lawscited by 3
- 2024Legal Fact Prediction: The Missing Piece in Legal Judgment Predictioncited by 3
- 2025AnnoCaseLaw: A Richly-Annotated Dataset For Benchmarking Explainable Legal Judgment Predictioncited by 3
- 2022Indian Legal Text Summarization: A Text Normalisation-based Approachcited by 2
- 2023HiPool: Modeling Long Documents Using Graph Neural Networkscited by 2
- 2025Can Large Language Models Predict the Outcome of Judicial Decisions?cited by 2
- 2025LegalBench.PT: A Benchmark for Portuguese Lawcited by 2
- 2025MARRO: Multi-headed Attention for Rhetorical Role Labeling in Legal Documentscited by 2
- 2023Adversarially Robust Neural Legal Judgement Systemscited by 1
- 2023A Hierarchical Neural Framework for Classification and its Explanation in Large Unstructured Legal Documentscited by 1
- 2023Exploring Graph Neural Networks for Indian Legal Judgment Predictioncited by 1
- 2024Convolutional Neural Networks can achieve binary bail judgement classificationcited by 1
- 2024InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for the Indian Legal Domain?cited by 1
50 most cited of 78 All 78 (JSON)
- 2026How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards16 Sep 2026
- 2026KhatianDoc: A Human-Verified Benchmark Diagnosing Multimodal LLM Failure on Bengali Legal Land Records3 Sep 2026
- 2026AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal System21 Jul 2026
- 2026Towards Explainable Adjudicative Variance: Quantifying Judicial Discretion via Gated Multi-Task Learning25 Jun 2026
- 2026Peeking Inside LLMs: Leveraging Internal Artifacts of LLMs for Enhancing Reliability in Legal Classification18 Jun 2026
- 2026HKJudge: A Legal Discourse-Annotated Corpus for Interpreting What Courts Find, How They Reason, and What They Rule4 Jun 2026
- 2026RTI-Bench: A Structured Dataset for Indian Right-to-Information Decision Analysis16 May 2026
- 2026IdeaForge: A Knowledge Graph-Grounded Multi-Agent Framework for Cross-Methodology Innovation Analysis and Patent Claim Generation13 May 2026
- 2026IndiaFinBench: An Evaluation Benchmark for Large Language Model Performance on Indian Financial Regulatory Text21 Apr 2026
- 2026SinhaLegal: A Benchmark Corpus for Information Extraction and Analysis in Sinhala Legislative Texts5 Mar 2026
- 2026Multimodal Multi-Agent Empowered Legal Judgment Prediction19 Jan 2026
- 2025Skim-Aware Contrastive Learning for Efficient Document Representation30 Dec 2025
38 more
- 2025IL-PCSR: Legal Corpus for Prior Case and Statute Retrieval31 Oct 2025
- 2025Judging by Appearances? Auditing and Intervening Vision-Language Models for Bail Prediction30 Sep 2025
- 2025LLMs for LLMs: A Structured Prompting Methodology for Long Legal Documents2 Sep 2025
- 2025Scaling Legal AI: Benchmarking Mamba and Transformers for Statutory Classification and Case Law Retrieval29 Aug 2025
- 2025ClaimGen-CN: A Large-scale Chinese Dataset for Legal Claim Generation24 Aug 2025
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law System1 Aug 2025
- 2025The Judge Variable: Challenging Judge-Agnostic Legal Judgment Prediction18 Jul 2025
- 2025JurisCTC: Enhancing Legal Judgment Prediction via Cross-Domain Transfer and Contrastive Learning24 Apr 2025
- 2025TathyaNyaya and FactLegalLlama: Advancing Factual Judgment Prediction and Explanation in the Indian Legal Context7 Apr 2025
- 2025Structured Legal Document Generation in India: A Model-Agnostic Wrapper Approach with VidhikDastaavej4 Apr 2025
- 2025MARRO: Multi-headed Attention for Rhetorical Role Labeling in Legal Documents8 Mar 2025
- 2025AnnoCaseLaw: A Richly-Annotated Dataset For Benchmarking Explainable Legal Judgment Prediction28 Feb 2025
- 2025LegalBench.PT: A Benchmark for Portuguese Law22 Feb 2025
- 2025LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classification9 Feb 2025
- 2025Can Large Language Models Predict the Outcome of Judicial Decisions?15 Jan 2025
- 2024No Argument Left Behind: Overlapping Chunks for Faster Processing of Arbitrarily Long Legal Texts24 Oct 2024
- 2024The Craft of Selective Prediction: Towards Reliable Case Outcome Classification -- An Empirical Study on European Court of Human Rights Cases27 Sep 2024
- 2024Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Cases27 Sep 2024
- 2024The FIX Benchmark: Extracting Features Interpretable to eXperts20 Sep 2024
- 2024Legal Fact Prediction: The Missing Piece in Legal Judgment Prediction11 Sep 2024
- 2024On Evaluating Explanation Utility for Human-AI Decision Making in NLP3 Jul 2024
- 2024Towards Supporting Legal Argumentation with NLP: Is More Data Really All You Need?16 Jun 2024
- 2024Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts6 Jun 2024
- 2024ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks23 May 2024
- 2024What's Mine becomes Yours: Defining, Annotating and Detecting Context-Dependent Paraphrases in News Interview Dialogs10 Apr 2024
- 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain2 Apr 2024
- 2024Towards Explainability in Legal Outcome Prediction Models25 Mar 2024
- 2024Ayn: A Tiny yet Competitive Indian Legal Language Model Pretrained from Scratch20 Mar 2024
- 2024Human Centered AI for Indian Legal Text Analytics16 Mar 2024
- 2024Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documents11 Mar 2024
- 2024Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Dataset26 Feb 2024
- 2024InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for the Indian Legal Domain?16 Feb 2024
- 2024PILOT: Legal Case Outcome Prediction with Case Law28 Jan 2024
- 2024Convolutional Neural Networks can achieve binary bail judgement classification25 Jan 2024
- 2023SLJP: Semantic Extraction based Legal Judgment Prediction13 Dec 2023
- 2023Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning10 Dec 2023
- 2023Fact-based Court Judgment Prediction22 Nov 2023
- 2023Exploring Graph Neural Networks for Indian Legal Judgment Prediction19 Oct 2023
50 newest of 78 All 78 (JSON)
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
- 2022Legal Prompt Engineering for Multilingual Legal Judgement Predictioncited by 54
- 2023LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Developmentcited by 54
- 2023Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaborationcited by 52
- 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
- 2022Pre-trained Language Models for the Legal Domain: A Case Study on Indian Lawcited by 39
- 2021Semantic Segmentation of Legal Documents via Rhetorical Rolescited by 26
- 2022Named Entity Recognition in Indian court judgmentscited by 26
- 2022Corpus for Automatic Structuring of Legal Documentscited by 25
- 2022Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformercited by 20
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
- 2023Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoningcited by 17
12 most cited of 76 All 76 (JSON)
- 2026How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards16 Sep 2026
- 2026KhatianDoc: A Human-Verified Benchmark Diagnosing Multimodal LLM Failure on Bengali Legal Land Records3 Sep 2026
- 2026AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal System21 Jul 2026
- 2026Towards Explainable Adjudicative Variance: Quantifying Judicial Discretion via Gated Multi-Task Learning25 Jun 2026
- 2026Peeking Inside LLMs: Leveraging Internal Artifacts of LLMs for Enhancing Reliability in Legal Classification18 Jun 2026
- 2026HKJudge: A Legal Discourse-Annotated Corpus for Interpreting What Courts Find, How They Reason, and What They Rule4 Jun 2026
- 2026RTI-Bench: A Structured Dataset for Indian Right-to-Information Decision Analysis16 May 2026
- 2026IndiaFinBench: An Evaluation Benchmark for Large Language Model Performance on Indian Financial Regulatory Text21 Apr 2026
- 2026SinhaLegal: A Benchmark Corpus for Information Extraction and Analysis in Sinhala Legislative Texts5 Mar 2026
- 2026Multimodal Multi-Agent Empowered Legal Judgment Prediction19 Jan 2026
- 2025Skim-Aware Contrastive Learning for Efficient Document Representation30 Dec 2025
- 2025IL-PCSR: Legal Corpus for Prior Case and Statute Retrieval31 Oct 2025
12 newest of 76 All 76 (JSON)