mlsanityData to 7 Oct 2026

Topic Classification of Case Law Using a Large Language Model and a New Taxonomy for UK Law: AI Insights into Summary Judgment

arXiv 2405.12910 ↗First posted 21 May 2024cs.CL cs.AI cs.CYcited by 3

Not on the map. Why?

Abstract (arXiv)

This paper addresses a critical gap in legal analytics by developing and applying a novel taxonomy for topic classification of summary judgment cases in the United Kingdom. Using a curated dataset of summary judgment cases, we use the Large Language Model Claude 3 Opus to explore functional topics and trends. We find that Claude 3 Opus correctly classified the topic with an accuracy of 87.13% and an F1 score of 0.87. The analysis reveals distinct patterns in the application of summary judgments across various legal domains. As case law in the United Kingdom is not originally labelled with keywords or a topic filtering option, the findings not only refine our understanding of the thematic underpinnings of summary judgments but also illustrate the potential of combining traditional and AI-driven approaches in legal classification. Therefore, this paper provides a new and general taxonomy for UK law. The implications of this work serve as a foundation for further research and policy discussions in the field of judicial administration and computational legal research methodologies.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 91 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

28 of 91 references.

References · 28

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  3. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  5. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  6. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  7. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
  8. 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 206
  9. 2024Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoningcited by 108
  10. 2024Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Modelscited by 104
  11. 2023Adaptation with Self-Evaluation to Improve Selective Prediction in LLMscited by 49
  12. 2024Efficient Prompting Methods for Large Language Models: A Surveycited by 46
16 more
  1. 2024Think Twice Before Trusting: Self-Detection for Large Language Models through Comprehensive Answer Reflectioncited by 40
  2. 2024Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultracited by 36
  3. 2024Large Language Models Offer an Alternative to the Traditional Approach of Topic Modellingcited by 35
  4. 2023SELF: Self-Evolution with Language Feedbackcited by 24
  5. 2023Using Large Language Models to Support Thematic Analysis in Empirical Legal Studiescited by 24
  6. 2023Prompting Large Language Models for Topic Modelingcited by 24
  7. 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLMcited by 16
  8. 2023The Cambridge Law Corpus: A Dataset for Legal AI Researchcited by 14
  9. 2019Legal Area Classification: A Comparative Study of Text Classifiers on Singapore Supreme Court Judgmentscited by 12
  10. 2024When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Modelscited by 12
  11. 2024LLM vs. Lawyers: Identifying a Subset of Summary Judgments in a Large UK Case Law Datasetcited by 8
  12. 2024Addressing Topic Granularity and Hallucination in Large Language Models for Topic Modellingcited by 7
  13. 2023Refining the Responses of LLMs by Themselvescited by 4
  14. 2024Combining topic modelling and citation network analysis to study case law from the European Court on Human Rights on the right to respect for private and family lifecited by 3
  15. 2023A Contextual Topic Modeling and Content Analysis of Iranian laws and Regulationscited by 1
  16. 2024Discovering Significant Topics from Legal Decisions with Selective Inferencecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026Method for Aggregating Unstructured Data Using Large Language Modelscited by 0
  2. 2026Towards Intelligent Legal Document Analysis: CNN-Driven Classification of Case Law Textscited by 0
  3. 2026DECODEM: Data Extraction from Corporate Organizational Documents via Enhanced Methodscited by 0