Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges
Not on the map. Why?
Abstract (arXiv)
Natural Language Processing (NLP) is revolutionising the way both professionals and laypersons operate in the legal field. The considerable potential for NLP in the legal sector, especially in developing computational assistance tools for various legal processes, has captured the interest of researchers for years. This survey follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, reviewing 154 studies, with a final selection of 131 after manual filtering. It explores foundational concepts related to NLP in the legal domain, illustrating the unique aspects and challenges of processing legal texts, such as extensive document lengths, complex language, and limited open legal datasets. We provide an overview of NLP tasks specific to legal text, such as Document Summarisation, Named Entity Recognition, Question Answering, Argument Mining, Text Classification, and Judgement Prediction. Furthermore, we analyse both developed legal-oriented language models, and approaches for adapting general-purpose language models to the legal domain. Additionally, we identify sixteen open research challenges, including the detection and mitigation of bias in artificial intelligence applications, the need for more robust and interpretable models, and improving explainability to handle the complexities of legal language and reasoning.
Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). Builds on 80 of its 163 references that are in the map. First posted on arXiv 25 Oct 2024.
Builds on
80 of 163 references.
References · 80
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2017Graph Attention Networkscited by 8,923
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 310
38 more
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
- 2019Neural Legal Judgment Prediction in Englishcited by 209
- 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 201
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 170
- 2021Understanding the Capabilities, Limitations, and Societal Impact of Large Language Modelscited by 160
- 2024Large Legal Fictions: Profiling Legal Hallucinations in Large Language Modelscited by 150
- 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 143
- 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 142
- 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 129
- 2019Fine-tune BERT for Extractive Summarizationcited by 122
- 2022Pretrained Language Models for Text Generation: A Surveycited by 122
- 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 116
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 116
- 2022Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Datasetcited by 113
- 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
- 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 90
- 2017One Model To Learn Them Allcited by 87
- 2024A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Lawcited by 74
- 2018CLAUDETTE: an Automated Detector of Potentially Unfair Clauses in Online Terms of Servicecited by 73
- 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
- 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
- 2021Multi-Task Learning in Natural Language Processing: An Overviewcited by 62
- 2017Learning to Predict Charges for Criminal Cases with Legal Basiscited by 61
- 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
- 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 60
- 2023A Short Survey of Viewing Large Language Models in Legal Aspectcited by 52
- 2019Legal Judgment Prediction via Multi-Perspective Bi-Feedback Networkcited by 50
- 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
- 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 49
- 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
- 2023Explaining Legal Concepts with Augmented Large Language Models (GPT-4)cited by 40
- 2018Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptionscited by 36
- 2022Mining Legal Arguments in Court Decisionscited by 35
- 2023ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmarkcited by 33
- 2019Extreme Multi-Label Legal Text Classification: A case study in EU Legislationcited by 26
- 2022Named Entity Recognition in Indian court judgmentscited by 26
- 2017NeuroNER: an easy-to-use program for named-entity recognition based on neural networkscited by 25
- 2020A Dataset of German Legal Documents for Named Entity Recognitioncited by 24
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2025: 16; 2026: 26.
42 papers.
Sort:
By area:
- 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasetscited by 12
- 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
- 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Modelscited by 10
- 2025A Comprehensive Survey on Legal Summarization: Challenges and Future Directionscited by 6
- 2025Evaluating LLM-Generated Legal Explanations for Regulatory Compliance in Social Media Influencer Marketingcited by 4
- 2025Prompting from the bench: Large-scale pretraining is not sufficient to prepare LLMs for ordinary meaning analysiscited by 4
- 2025Measuring Faithfulness and Abstention: An Automated Pipeline for Evaluating LLM-Generated 3-ply Case-Based Legal Argumentscited by 3
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governancecited by 3
- 2025AutoSpec: An Agentic Framework for Automatically Drafting Patent Specificationcited by 3
- 2025Mina: A Multilingual LLM-Powered Legal Assistant Agent for Bangladesh for Empowering Access to Justicecited by 2
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mappingcited by 2
- 2026ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detectioncited by 2
30 more
- 2025Exploring Selective Retrieval-Augmentation for Long-Tail Legal Text Classificationcited by 1
- 2025Hybrid Topic-Semantic Labeling and Graph Embeddings for Unsupervised Legal Document Clusteringcited by 1
- 2025From Answers to Guidance: A Proactive Dialogue System for Legal Documentscited by 1
- 2026LEMUR: A Corpus for Robust Fine-Tuning of Multilingual Law Embedding Models for Retrievalcited by 1
- 2026SinhaLegal: A Benchmark Corpus for Information Extraction and Analysis in Sinhala Legislative Textscited by 1
- 2026PYTHEN: A Flexible Framework for Legal Reasoning in Pythoncited by 1
- 2026Swiss-Bench SBP-002: A Frontier Model Comparison on Swiss Legal and Regulatory Taskscited by 1
- 2026Beyond Case Law: Evaluating Structure-Aware Retrieval and Safety in Statute-Centric Legal QAcited by 1
- 2026Multilinguality at the Edge: Developing Language Models for the Global Southcited by 1
- 2026Beyond Imperfect Alternatives with Rulemapping: A Neuro-Symbolic Case Study on Online Hate Speechcited by 1
- 2026Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answeringcited by 1
- 2026Beyond Goodhart's Law: A Dynamic Benchmark for Evaluating Compliance in Multi-Agent Systemscited by 1
- 2026From Statute to Control Flow: Span-Grounded Deontic Trees for Defeasible Scope Parsingcited by 1
- 2026GVD: Governed Versioning and Deduplication for Document Repositoriescited by 1
- 2025FlexiDataGen: An Adaptive LLM Framework for Dynamic Semantic Dataset Generation in Sensitive Domainscited by 0
- 2025AugAbEx: Bridging Abstractive and Extractive Legal Summarizationcited by 0
- 2026Chinese Labor Law Large Language Model Benchmarkcited by 0
- 2026ADVOSYNTH: A Synthetic Multi-Advocate Dataset for Speaker Identification in Courtroom Scenarioscited by 0
- 2026NLP for Local Governance Meeting Records: A Focus Article on Tasks, Datasets, Metrics and Benchmarkcited by 0
- 2026LAMUS: A Large-Scale Corpus for Legal Argument Mining from U.S. Caselaw using LLMscited by 0
- 2026Improving Infinitely Deep Bayesian Neural Networks with Nesterov's Accelerated Gradient Methodcited by 0
- 2026JU'A -- A Benchmark for Information Retrieval in Brazilian Legal Text Collectionscited by 0
- 2026LLMs as annotators of credibility assessment in Danish asylum decisions: evaluating classification performance and errors beyond aggregated metricscited by 0
- 2026Maat: The Agentic Legal Research Assistant for Competition Protectioncited by 0
- 2026Retrieval Augmented Generation Framework for the Nepali Legal Domain Question Answeringcited by 0
- 2026LAUKIN: A Multi-jurisdictional Common Law Contract Datasetcited by 0
- 2026DECODEM: Data Extraction from Corporate Organizational Documents via Enhanced Methodscited by 0
- 2026BLAD: A Historically Contextualized, Multilingual Dataset of Bangladeshi Legal Acts (1799 to 2025)cited by 0
- 2026ANNOTARES: A Dataset for Extracting Logical Structures from German Statutory Textscited by 0
- 2026SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documentscited by 0
- 2026SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documents26 Sep 2026
- 2026GVD: Governed Versioning and Deduplication for Document Repositories15 Sep 2026
- 2026ANNOTARES: A Dataset for Extracting Logical Structures from German Statutory Texts4 Aug 2026
- 2026BLAD: A Historically Contextualized, Multilingual Dataset of Bangladeshi Legal Acts (1799 to 2025)19 Jul 2026
- 2026DECODEM: Data Extraction from Corporate Organizational Documents via Enhanced Methods17 Jul 2026
- 2026LAUKIN: A Multi-jurisdictional Common Law Contract Dataset11 Jun 2026
- 2026From Statute to Control Flow: Span-Grounded Deontic Trees for Defeasible Scope Parsing8 Jun 2026
- 2026Beyond Goodhart's Law: A Dynamic Benchmark for Evaluating Compliance in Multi-Agent Systems5 Jun 2026
- 2026Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answering28 May 2026
- 2026Maat: The Agentic Legal Research Assistant for Competition Protection26 May 2026
- 2026LLMs as annotators of credibility assessment in Danish asylum decisions: evaluating classification performance and errors beyond aggregated metrics13 May 2026
- 2026ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detection26 Apr 2026
30 more
- 2026Multilinguality at the Edge: Developing Language Models for the Global South23 Apr 2026
- 2026Retrieval Augmented Generation Framework for the Nepali Legal Domain Question Answering20 Apr 2026
- 2026Beyond Imperfect Alternatives with Rulemapping: A Neuro-Symbolic Case Study on Online Hate Speech10 Apr 2026
- 2026JU'A -- A Benchmark for Information Retrieval in Brazilian Legal Text Collections7 Apr 2026
- 2026Improving Infinitely Deep Bayesian Neural Networks with Nesterov's Accelerated Gradient Method26 Mar 2026
- 2026Swiss-Bench SBP-002: A Frontier Model Comparison on Swiss Legal and Regulatory Tasks24 Mar 2026
- 2026PYTHEN: A Flexible Framework for Legal Reasoning in Python16 Mar 2026
- 2026LAMUS: A Large-Scale Corpus for Legal Argument Mining from U.S. Caselaw using LLMs9 Mar 2026
- 2026SinhaLegal: A Benchmark Corpus for Information Extraction and Analysis in Sinhala Legislative Texts5 Mar 2026
- 2026LEMUR: A Corpus for Robust Fine-Tuning of Multilingual Law Embedding Models for Retrieval10 Feb 2026
- 2026NLP for Local Governance Meeting Records: A Focus Article on Tasks, Datasets, Metrics and Benchmark8 Feb 2026
- 2026Beyond Case Law: Evaluating Structure-Aware Retrieval and Safety in Statute-Centric Legal QA24 Jan 2026
- 2026ADVOSYNTH: A Synthetic Multi-Advocate Dataset for Speaker Identification in Courtroom Scenarios15 Jan 2026
- 2026Chinese Labor Law Large Language Model Benchmark15 Jan 2026
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mapping15 Dec 2025
- 2025AugAbEx: Bridging Abstractive and Extractive Legal Summarization15 Nov 2025
- 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Models11 Nov 2025
- 2025Mina: A Multilingual LLM-Powered Legal Assistant Agent for Bangladesh for Empowering Access to Justice4 Nov 2025
- 2025Prompting from the bench: Large-scale pretraining is not sufficient to prepare LLMs for ordinary meaning analysis29 Oct 2025
- 2025From Answers to Guidance: A Proactive Dialogue System for Legal Documents22 Oct 2025
- 2025FlexiDataGen: An Adaptive LLM Framework for Dynamic Semantic Dataset Generation in Sensitive Domains21 Oct 2025
- 2025Evaluating LLM-Generated Legal Explanations for Regulatory Compliance in Social Media Influencer Marketing9 Oct 2025
- 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasets8 Oct 2025
- 2025AutoSpec: An Agentic Framework for Automatically Drafting Patent Specification23 Sep 2025
- 2025Large Language Models Meet Legal Artificial Intelligence: A Survey12 Sep 2025
- 2025Hybrid Topic-Semantic Labeling and Graph Embeddings for Unsupervised Legal Document Clustering31 Aug 2025
- 2025Exploring Selective Retrieval-Augmentation for Long-Tail Legal Text Classification27 Aug 2025
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governance10 Jul 2025
- 2025Measuring Faithfulness and Abstention: An Automated Pipeline for Evaluating LLM-Generated 3-ply Case-Based Legal Arguments31 May 2025
- 2025A Comprehensive Survey on Legal Summarization: Challenges and Future Directions29 Jan 2025
- 2025AutoSpec: An Agentic Framework for Automatically Drafting Patent Specificationcited by 3
- 2025Mina: A Multilingual LLM-Powered Legal Assistant Agent for Bangladesh for Empowering Access to Justicecited by 2
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mappingcited by 2
- 2026Beyond Goodhart's Law: A Dynamic Benchmark for Evaluating Compliance in Multi-Agent Systemscited by 1
- 2026Beyond Goodhart's Law: A Dynamic Benchmark for Evaluating Compliance in Multi-Agent Systems5 Jun 2026
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mapping15 Dec 2025
- 2025Mina: A Multilingual LLM-Powered Legal Assistant Agent for Bangladesh for Empowering Access to Justice4 Nov 2025
- 2025AutoSpec: An Agentic Framework for Automatically Drafting Patent Specification23 Sep 2025
- 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
- 2025A Comprehensive Survey on Legal Summarization: Challenges and Future Directionscited by 6
- 2025Evaluating LLM-Generated Legal Explanations for Regulatory Compliance in Social Media Influencer Marketingcited by 4
- 2025Prompting from the bench: Large-scale pretraining is not sufficient to prepare LLMs for ordinary meaning analysiscited by 4
- 2025Measuring Faithfulness and Abstention: An Automated Pipeline for Evaluating LLM-Generated 3-ply Case-Based Legal Argumentscited by 3
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governancecited by 3
- 2026ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detectioncited by 2
- 2025Exploring Selective Retrieval-Augmentation for Long-Tail Legal Text Classificationcited by 1
- 2025Hybrid Topic-Semantic Labeling and Graph Embeddings for Unsupervised Legal Document Clusteringcited by 1
- 2025From Answers to Guidance: A Proactive Dialogue System for Legal Documentscited by 1
- 2026LEMUR: A Corpus for Robust Fine-Tuning of Multilingual Law Embedding Models for Retrievalcited by 1
- 2026SinhaLegal: A Benchmark Corpus for Information Extraction and Analysis in Sinhala Legislative Textscited by 1
12 most cited of 35 All 35 (JSON)
- 2026SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documents26 Sep 2026
- 2026GVD: Governed Versioning and Deduplication for Document Repositories15 Sep 2026
- 2026ANNOTARES: A Dataset for Extracting Logical Structures from German Statutory Texts4 Aug 2026
- 2026BLAD: A Historically Contextualized, Multilingual Dataset of Bangladeshi Legal Acts (1799 to 2025)19 Jul 2026
- 2026DECODEM: Data Extraction from Corporate Organizational Documents via Enhanced Methods17 Jul 2026
- 2026LAUKIN: A Multi-jurisdictional Common Law Contract Dataset11 Jun 2026
- 2026From Statute to Control Flow: Span-Grounded Deontic Trees for Defeasible Scope Parsing8 Jun 2026
- 2026Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answering28 May 2026
- 2026Maat: The Agentic Legal Research Assistant for Competition Protection26 May 2026
- 2026LLMs as annotators of credibility assessment in Danish asylum decisions: evaluating classification performance and errors beyond aggregated metrics13 May 2026
- 2026ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detection26 Apr 2026
- 2026Multilinguality at the Edge: Developing Language Models for the Global South23 Apr 2026
12 newest of 35 All 35 (JSON)