mlsanityData to 14 Oct 2026

Large Language Models in Law: A Survey

arXiv 2312.03718 ↗First posted 26 Nov 2023cs.CL cs.AIcited by 128

Not on the map. Why?

Abstract (arXiv)

The advent of artificial intelligence (AI) has significantly impacted the traditional judicial industry. Moreover, recently, with the development of AI-generated content (AIGC), AI and law have found applications in various domains, including image recognition, automatic text generation, and interactive chat. With the rapid emergence and growing popularity of large models, it is evident that AI will drive transformation in the traditional judicial industry. However, the application of legal large language models (LLMs) is still in its nascent stage. Several challenges need to be addressed. In this paper, we aim to provide a comprehensive survey of legal LLMs. We not only conduct an extensive survey of LLMs, but also expose their applications in the judicial system. We first provide an overview of AI technologies in the legal field and showcase the recent research in LLMs. Then, we discuss the practical implementation presented by legal LLMs, such as providing legal advice to users and assisting judges during trials. In addition, we explore the limitations of legal LLMs, including data, algorithms, and judicial practice. Finally, we summarize practical recommendations and propose future development directions to address these challenges.

Key facts. Cited by 128 papers in the map (data through 14 Oct 2026). Builds on 61 of its 168 references that are in the map. First posted on arXiv 26 Nov 2023.

Builds on

61 of 168 references.

References · 61

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  8. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  11. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  12. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
38 more
  1. 2020Extracting Training Data from Large Language Modelscited by 2,189
  2. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  3. 2018Self-Attention with Relative Position Representationscited by 1,120
  4. 2022Diffusion Models in Vision: A Surveycited by 1,015
  5. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  6. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  7. 2017A Survey on Multi-Task Learningcited by 840
  8. 2021Transformer in Transformercited by 633
  9. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 618
  10. 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 559
  11. 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 536
  12. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
  13. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
  14. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 296
  15. 2014Caffe: Convolutional Architecture for Fast Feature Embeddingcited by 288
  16. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 254
  17. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
  18. 2021Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasetscited by 181
  19. 2015Sequence to Sequence -- Video to Textcited by 158
  20. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 154
  21. 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
  22. 2019The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectivescited by 139
  23. 2021PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computationcited by 134
  24. 2023Large Language Models for Robotics: A Surveycited by 133
  25. 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 129
  26. 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 116
  27. 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 116
  28. 2022What Language Model to Train if You Have One Million GPU Hours?cited by 92
  29. 2020PyTorch Distributed: Experiences on Accelerating Data Parallel Trainingcited by 90
  30. 2022Shortcut Learning of Large Language Models in Natural Language Understandingcited by 85
  31. 2020Why Fairness Cannot Be Automated: Bridging the Gap Between EU Non-Discrimination Law and AIcited by 81
  32. 2021AI in Finance: Challenges, Techniques and Opportunitiescited by 81
  33. 2020Deep Learning for Procedural Content Generationcited by 73
  34. 2020When Machine Learning Meets Privacy: A Survey and Outlookcited by 68
  35. 2023AI-Generated Content (AIGC): A Surveycited by 59
  36. 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
  37. 2023Large Language Models in Education: Vision and Opportunitiescited by 54
  38. 2021A Review on Explainability in Multimodal Deep Neural Netscited by 46

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 31; 2025: 67; 2026: 30.

128 papers.

Sort:

By area:

  1. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  2. 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
  3. 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 71
  4. 2025Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoningcited by 63
  5. 2025LLM Agents for Education: Advances and Applicationscited by 59
  6. 2024Knowledge Mechanisms in Large Language Models: A Survey and Perspectivecited by 51
  7. 2024Large Language Models for Medicine: A Surveycited by 38
  8. 2024DOCBENCH: A Benchmark for Evaluating LLM-based Document Reading Systemscited by 37
  9. 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agentscited by 37
  10. 2024Large Language Models for Education: A Surveycited by 34
  11. 2025Defending against Indirect Prompt Injection by Instruction Detectioncited by 32
  12. 2025Towards Trustworthy Retrieval Augmented Generation for Large Language Models: A Surveycited by 30
38 more
  1. 2024WordGame: Efficient & Effective LLM Jailbreak via Simultaneous Obfuscation in Query and Responsecited by 29
  2. 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 27
  3. 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 26
  4. 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
  5. 2024Watermarking Techniques for Large Language Models: A Surveycited by 23
  6. 2025Primus: A Pioneering Collection of Open-Source Datasets for Cybersecurity LLM Trainingcited by 23
  7. 2025Revisiting Uncertainty Estimation and Calibration of Large Language Modelscited by 23
  8. 2024A Study on Large Language Models' Limitations in Multiple-Choice Question Answeringcited by 22
  9. 2025SteerConf: Steering LLMs for Confidence Elicitationcited by 20
  10. 2024An overview of domain-specific foundation model: key technologies, applications and challengescited by 19
  11. 2025LLMs Provide Unstable Answers to Legal Questionscited by 19
  12. 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversationcited by 19
  13. 2025Mixture of Experts (MoE): A Big Data Perspectivecited by 18
  14. 2025Standard Benchmarks Fail -- Auditing LLM Agents in Finance Must Prioritize Riskcited by 13
  15. 2025PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claimscited by 11
  16. 2024Incentivizing Quality Text Generation via Statistical Contractscited by 10
  17. 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
  18. 2024MM-MoralBench: A MultiModal Moral Evaluation Benchmark for Large Vision-Language Modelscited by 9
  19. 2025Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoningcited by 9
  20. 2025Tools in the Loop: Quantifying Uncertainty of LLM Question Answering Systems That Use Toolscited by 9
  21. 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generationcited by 9
  22. 2024Measuring the Measurers: Quality Evaluation of Hallucination Benchmarks for Large Vision-Language Modelscited by 8
  23. 2025CaseGen: A Benchmark for Multi-Stage Legal Case Documents Generationcited by 8
  24. 2025Beyond Pointwise Scores: Decomposed Criteria-Based Evaluation of LLM Responsescited by 8
  25. 2025Can Pre-training Indicators Reliably Predict Fine-tuning Outcomes of LLMs?cited by 7
  26. 2025Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair Usecited by 6
  27. 2025GuRE:Generative Query REwriter for Legal Passage Retrievalcited by 6
  28. 2025From ASR to ASP: Evaluating Prompt Attack Vulnerabilities Against Open-Source LLMscited by 6
  29. 2025AIReg-Bench: Benchmarking Language Models That Assess AI Regulation Compliancecited by 6
  30. 2024It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Humancited by 5
  31. 2024ELLA: Empowering LLMs for Interpretable, Accurate and Informative Legal Advicecited by 5
  32. 2025The Hidden Structure -- Improving Legal Document Understanding Through Explicit Text Formattingcited by 5
  33. 2025Large Language Model Sourcing: A Surveycited by 5
  34. 2026LLM Agents in Law: Taxonomy, Applications, and Challengescited by 5
  35. 2024Legal Evalutions and Challenges of Large Language Modelscited by 4
  36. 2025This Is Your Doge, If It Please You: Exploring Deception and Robustness in Mixture of LLMscited by 4
  37. 2025Dutch CrowS-Pairs: Adapting a Challenge Dataset for Measuring Social Biases in Language Models for Dutchcited by 4
  38. 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goalscited by 3

50 most cited of 128 All 128 (JSON)