Hallucination is the last thing you need
Not on the map. Why?
Abstract (arXiv)
The legal profession necessitates a multidimensional approach that involves synthesizing an in-depth comprehension of a legal issue with insightful commentary based on personal experience, combined with a comprehensive understanding of pertinent legislation, regulation, and case law, in order to deliver an informed legal solution. The present offering with generative AI presents major obstacles in replicating this, as current models struggle to integrate and navigate such a complex interplay of understanding, experience, and fact-checking procedures. It is noteworthy that where generative AI outputs understanding and experience, which reflect the aggregate of various subjective views on similar topics, this often deflects the model's attention from the crucial legal facts, thereby resulting in hallucination. Hence, this paper delves into the feasibility of three independent LLMs, each focused on understanding, experience, and facts, synthesising as one single ensemble model to effectively counteract the current challenges posed by the existing monolithic generative AI models. We introduce an idea of mutli-length tokenisation to protect key information assets like common law judgements, and finally we interrogate the most advanced publicly available models for legal hallucination, with some interesting results.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 1 of its 3 references that are in the map. First posted on arXiv 20 Jun 2023.
Builds on
1 of 3 references.
References · 1
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 3; 2026: 1.
11 papers.
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2024Language Models with Conformal Factuality Guaranteescited by 128
- 2023Cognitive Mirage: A Review of Hallucinations in Large Language Modelscited by 83
- 2024LLMs Will Always Hallucinate, and We Need to Live With Thiscited by 77
- 2024Confabulation: The Surprising Value of Large Language Model Hallucinationscited by 42
- 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 24
- 2024Evaluating Consistency and Reasoning Capabilities of Large Language Modelscited by 7
- 2025SMAGDi: Socratic Multi Agent Interaction Graph Distillation for Efficient High Accuracy Reasoningcited by 3
- 2026Structure Guided Retrieval-Augmented Generation for Factual Queriescited by 2
- 2025Valuable Hallucinations: Realizable Non-realistic Propositionscited by 0
- 2026Structure Guided Retrieval-Augmented Generation for Factual Queries21 Apr 2026
- 2025SMAGDi: Socratic Multi Agent Interaction Graph Distillation for Efficient High Accuracy Reasoning29 Oct 2025
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMs6 Jun 2025
- 2025Valuable Hallucinations: Realizable Non-realistic Propositions16 Feb 2025
- 2024LLMs Will Always Hallucinate, and We Need to Live With This9 Sep 2024
- 2024Confabulation: The Surprising Value of Large Language Model Hallucinations6 Jun 2024
- 2024Evaluating Consistency and Reasoning Capabilities of Large Language Models25 Apr 2024
- 2024Language Models with Conformal Factuality Guarantees15 Feb 2024
- 2024AI Hallucinations: A Misnomer Worth Clarifying9 Jan 2024
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity11 Oct 2023
- 2023Cognitive Mirage: A Review of Hallucinations in Large Language Models13 Sep 2023