mlsanityData to 14 Oct 2026

Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges

arXiv 2410.21306 ↗First posted 25 Oct 2024cs.CL cs.AIcited by 42

Not on the map. Why?

Abstract (arXiv)

Natural Language Processing (NLP) is revolutionising the way both professionals and laypersons operate in the legal field. The considerable potential for NLP in the legal sector, especially in developing computational assistance tools for various legal processes, has captured the interest of researchers for years. This survey follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, reviewing 154 studies, with a final selection of 131 after manual filtering. It explores foundational concepts related to NLP in the legal domain, illustrating the unique aspects and challenges of processing legal texts, such as extensive document lengths, complex language, and limited open legal datasets. We provide an overview of NLP tasks specific to legal text, such as Document Summarisation, Named Entity Recognition, Question Answering, Argument Mining, Text Classification, and Judgement Prediction. Furthermore, we analyse both developed legal-oriented language models, and approaches for adapting general-purpose language models to the legal domain. Additionally, we identify sixteen open research challenges, including the detection and mitigation of bias in artificial intelligence applications, the need for more robust and interpretable models, and improving explainability to handle the complexities of legal language and reasoning.

Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). Builds on 80 of its 163 references that are in the map. First posted on arXiv 25 Oct 2024.

Builds on

80 of 163 references.

References · 80

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2017Graph Attention Networkscited by 8,923
  8. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  9. 2020Longformer: The Long-Document Transformercited by 3,413
  10. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
  11. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  12. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 310
38 more
  1. 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
  2. 2019Neural Legal Judgment Prediction in Englishcited by 209
  3. 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 201
  4. 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 170
  5. 2021Understanding the Capabilities, Limitations, and Societal Impact of Large Language Modelscited by 160
  6. 2024Large Legal Fictions: Profiling Legal Hallucinations in Large Language Modelscited by 150
  7. 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 143
  8. 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 142
  9. 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 129
  10. 2019Fine-tune BERT for Extractive Summarizationcited by 122
  11. 2022Pretrained Language Models for Text Generation: A Surveycited by 122
  12. 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 116
  13. 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 116
  14. 2022Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Datasetcited by 113
  15. 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
  16. 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 90
  17. 2017One Model To Learn Them Allcited by 87
  18. 2024A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Lawcited by 74
  19. 2018CLAUDETTE: an Automated Detector of Potentially Unfair Clauses in Online Terms of Servicecited by 73
  20. 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
  21. 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
  22. 2021Multi-Task Learning in Natural Language Processing: An Overviewcited by 62
  23. 2017Learning to Predict Charges for Criminal Cases with Legal Basiscited by 61
  24. 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
  25. 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 60
  26. 2023A Short Survey of Viewing Large Language Models in Legal Aspectcited by 52
  27. 2019Legal Judgment Prediction via Multi-Perspective Bi-Feedback Networkcited by 50
  28. 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
  29. 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 49
  30. 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
  31. 2023Explaining Legal Concepts with Augmented Large Language Models (GPT-4)cited by 40
  32. 2018Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptionscited by 36
  33. 2022Mining Legal Arguments in Court Decisionscited by 35
  34. 2023ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmarkcited by 33
  35. 2019Extreme Multi-Label Legal Text Classification: A case study in EU Legislationcited by 26
  36. 2022Named Entity Recognition in Indian court judgmentscited by 26
  37. 2017NeuroNER: an easy-to-use program for named-entity recognition based on neural networkscited by 25
  38. 2020A Dataset of German Legal Documents for Named Entity Recognitioncited by 24

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 16; 2026: 26.

42 papers.

Sort:

By area:

  1. 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasetscited by 12
  2. 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
  3. 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Modelscited by 10
  4. 2025A Comprehensive Survey on Legal Summarization: Challenges and Future Directionscited by 6
  5. 2025Evaluating LLM-Generated Legal Explanations for Regulatory Compliance in Social Media Influencer Marketingcited by 4
  6. 2025Prompting from the bench: Large-scale pretraining is not sufficient to prepare LLMs for ordinary meaning analysiscited by 4
  7. 2025Measuring Faithfulness and Abstention: An Automated Pipeline for Evaluating LLM-Generated 3-ply Case-Based Legal Argumentscited by 3
  8. 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governancecited by 3
  9. 2025AutoSpec: An Agentic Framework for Automatically Drafting Patent Specificationcited by 3
  10. 2025Mina: A Multilingual LLM-Powered Legal Assistant Agent for Bangladesh for Empowering Access to Justicecited by 2
  11. 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mappingcited by 2
  12. 2026ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detectioncited by 2
30 more
  1. 2025Exploring Selective Retrieval-Augmentation for Long-Tail Legal Text Classificationcited by 1
  2. 2025Hybrid Topic-Semantic Labeling and Graph Embeddings for Unsupervised Legal Document Clusteringcited by 1
  3. 2025From Answers to Guidance: A Proactive Dialogue System for Legal Documentscited by 1
  4. 2026LEMUR: A Corpus for Robust Fine-Tuning of Multilingual Law Embedding Models for Retrievalcited by 1
  5. 2026SinhaLegal: A Benchmark Corpus for Information Extraction and Analysis in Sinhala Legislative Textscited by 1
  6. 2026PYTHEN: A Flexible Framework for Legal Reasoning in Pythoncited by 1
  7. 2026Swiss-Bench SBP-002: A Frontier Model Comparison on Swiss Legal and Regulatory Taskscited by 1
  8. 2026Beyond Case Law: Evaluating Structure-Aware Retrieval and Safety in Statute-Centric Legal QAcited by 1
  9. 2026Multilinguality at the Edge: Developing Language Models for the Global Southcited by 1
  10. 2026Beyond Imperfect Alternatives with Rulemapping: A Neuro-Symbolic Case Study on Online Hate Speechcited by 1
  11. 2026Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answeringcited by 1
  12. 2026Beyond Goodhart's Law: A Dynamic Benchmark for Evaluating Compliance in Multi-Agent Systemscited by 1
  13. 2026From Statute to Control Flow: Span-Grounded Deontic Trees for Defeasible Scope Parsingcited by 1
  14. 2026GVD: Governed Versioning and Deduplication for Document Repositoriescited by 1
  15. 2025FlexiDataGen: An Adaptive LLM Framework for Dynamic Semantic Dataset Generation in Sensitive Domainscited by 0
  16. 2025AugAbEx: Bridging Abstractive and Extractive Legal Summarizationcited by 0
  17. 2026Chinese Labor Law Large Language Model Benchmarkcited by 0
  18. 2026ADVOSYNTH: A Synthetic Multi-Advocate Dataset for Speaker Identification in Courtroom Scenarioscited by 0
  19. 2026NLP for Local Governance Meeting Records: A Focus Article on Tasks, Datasets, Metrics and Benchmarkcited by 0
  20. 2026LAMUS: A Large-Scale Corpus for Legal Argument Mining from U.S. Caselaw using LLMscited by 0
  21. 2026Improving Infinitely Deep Bayesian Neural Networks with Nesterov's Accelerated Gradient Methodcited by 0
  22. 2026JU'A -- A Benchmark for Information Retrieval in Brazilian Legal Text Collectionscited by 0
  23. 2026LLMs as annotators of credibility assessment in Danish asylum decisions: evaluating classification performance and errors beyond aggregated metricscited by 0
  24. 2026Maat: The Agentic Legal Research Assistant for Competition Protectioncited by 0
  25. 2026Retrieval Augmented Generation Framework for the Nepali Legal Domain Question Answeringcited by 0
  26. 2026LAUKIN: A Multi-jurisdictional Common Law Contract Datasetcited by 0
  27. 2026DECODEM: Data Extraction from Corporate Organizational Documents via Enhanced Methodscited by 0
  28. 2026BLAD: A Historically Contextualized, Multilingual Dataset of Bangladeshi Legal Acts (1799 to 2025)cited by 0
  29. 2026ANNOTARES: A Dataset for Extracting Logical Structures from German Statutory Textscited by 0
  30. 2026SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documentscited by 0