mlsanityData to 7 Oct 2026

Factuality of Large Language Models: A Survey

arXiv 2402.02420 ↗First posted 4 Feb 2024cs.CL cs.AIcited by 64

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a straightforward answer to a variety of questions in a single place. Unfortunately, in many cases, LLM responses are factually incorrect, which limits their applicability in real-world scenarios. As a result, research on evaluating and improving the factuality of LLMs has attracted a lot of attention recently. In this survey, we critically analyze existing work with the aim to identify the major challenges and their associated causes, pointing out to potential solutions for improving the factuality of LLMs, and analyzing the obstacles to automated factuality evaluation for open-ended text generation. We further offer an outlook on where future research should go.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 46 of its 56 references that are in the map. First posted on arXiv 4 Feb 2024.

Builds on

46 of 56 references.

References · 46

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  10. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  11. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  12. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
34 more
  1. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  4. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  5. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  6. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  7. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  8. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  9. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  10. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  11. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  12. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 671
  13. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  14. 2021Fast Model Editing at Scalecited by 491
  15. 2018Behavioral Cloning from Observationcited by 482
  16. 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
  17. 2021A Survey on Automated Fact-Checkingcited by 376
  18. 2023A Survey of Hallucination in Large Foundation Modelscited by 365
  19. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 319
  20. 2023How Language Model Hallucinations Can Snowballcited by 310
  21. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  22. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  23. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
  24. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 247
  25. 2023Fine-tuning Language Models for Factualitycited by 219
  26. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
  27. 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 202
  28. 2023The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediationscited by 130
  29. 2023Generating Benchmarks for Factuality Evaluation of Language Modelscited by 103
  30. 2023FELM: Benchmarking Factuality Evaluation of Large Language Modelscited by 66
  31. 2023Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Studycited by 63
  32. 2023Ever: Mitigating Hallucination in Large Language Models through Real-Time Verification and Rectificationcited by 38
  33. 2023Halo: Estimation and Reduction of Hallucinations in Open-Source Weak Large Language Modelscited by 36
  34. 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuningcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 38; 2026: 20.

64 papers.

Sort:

By area:

  1. 2025HalluLens: LLM Hallucination Benchmarkcited by 88
  2. 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 62
  3. 2025Eliciting Language Model Behaviors with Investigator Agentscited by 21
  4. 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
  5. 2024Loki: An Open-Source Tool for Fact Verificationcited by 16
  6. 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
  7. 2025Robustness in Large Language Models: A Survey of Mitigation Strategies and Evaluation Metricscited by 12
  8. 2025Video SimpleQA: Towards Factuality Evaluation in Large Video Language Modelscited by 11
  9. 2024How Reliable are LLMs as Knowledge Bases? Re-thinking Facutality and Consistencycited by 10
  10. 2025Test-Time Scaling in Reasoning Models Is Not Effective for Knowledge-Intensive Tasks Yetcited by 10
  11. 2025Right Is Not Enough: The Pitfalls of Outcome Supervision in Training LLMs for Math Reasoningcited by 9
  12. 2025From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulationcited by 8
38 more
  1. 2024Organizing Unstructured Image Collections using Natural Languagecited by 7
  2. 2025HICD: Hallucination-Inducing via Attention Dispersion for Contrastive Decoding to Mitigate Hallucinations in Large Language Modelscited by 7
  3. 2025Challenges for Generative AI in Legal Reasoningcited by 7
  4. 2024Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Modelscited by 6
  5. 2025How Does Response Length Affect Long-Form Factualitycited by 6
  6. 2025DAMR: Efficient and Adaptive Context-Aware Knowledge Graph Question Answering with LLM-Guided MCTScited by 6
  7. 2025PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactionscited by 5
  8. 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Makingcited by 4
  9. 2025A Comprehensive Taxonomy of Negation for NLP and Neural Retrieverscited by 4
  10. 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systemscited by 4
  11. 2025MR-Align: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Modelscited by 4
  12. 2025On the Adaptive Psychological Persuasion of Large Language Modelscited by 3
  13. 2025Querying Large Automotive Software Models: Agentic vs. Direct LLM Approachescited by 3
  14. 2025The Curious Case of Factuality Finetuning: Models' Internal Beliefs Can Improve Factualitycited by 3
  15. 2025Lie to Me: Knowledge Graphs for Robust Hallucination Self-Detection in LLMscited by 3
  16. 2026STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generationcited by 3
  17. 2024"Sorry, Come Again?" Prompting -- Enhancing Comprehension and Diminishing Hallucination with [PAUSE]-injected Optimal Paraphrasingcited by 2
  18. 2025The Illusionist's Prompt: Exposing the Factual Vulnerabilities of Large Language Models with Linguistic Nuancescited by 2
  19. 2025NEXT-EVAL: Next Evaluation of Traditional and LLM Web Data Record Extractioncited by 2
  20. 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systemscited by 2
  21. 2025Comprehensiveness Metrics for Automatic Evaluation of Factual Recall in Text Generationcited by 2
  22. 2025LLM×MapReduce-V3: Enabling Interactive In-Depth Survey Generation through a MCP-Driven Hierarchically Modular Agent Systemcited by 2
  23. 2026Small Updates, Big Doubts: Does Parameter-Efficient Fine-tuning Enhance Hallucination Detection ?cited by 2
  24. 2025Pitfalls of Scale: Investigating the Inverse Task of Redefinition in Large Language Modelscited by 1
  25. 2025ScEdit: Script-based Assessment of Knowledge Editingcited by 1
  26. 2025Probabilistic distances-based hallucination detection in LLMs with RAGcited by 1
  27. 2025KG-CQR: Leveraging Structured Relation Representations in Knowledge Graphs for Contextual Query Retrievalcited by 1
  28. 2026MedRAGChecker: Claim-Level Verification for Biomedical Retrieval-Augmented Generationcited by 1
  29. 2026Overreliance on AI in Information-seeking from Video Contentcited by 1
  30. 2026Don't Click That: Teaching Web Agents to Resist Deceptive Interfacescited by 1
  31. 2026Fine-Tuning Without Forgetting via Loss-Adaptive Learning Ratescited by 1
  32. 2026Whose Name Comes Up? III: Persona Prompting Effects in LLM-Based Scholar Recommendationcited by 1
  33. 2025AssertBench: A Benchmark for Evaluating Self-Assertion in Large Language Modelscited by 0
  34. 2025GIER: Gap-Driven Self-Refinement for Large Language Modelscited by 0
  35. 2025Exploring NLP Benchmarks in an Extremely Low-Resource Settingcited by 0
  36. 2025ScenarioBench: Trace-Grounded Compliance Evaluation for Text-to-SQL and RAGcited by 0
  37. 2025An Annotation Scheme for Factuality and its Application to Parliamentary Proceedingscited by 0
  38. 2025Generating Findings for Jaw Cysts in Dental Panoramic Radiographs Using a GPT-Based VLM: A Preliminary Study on Building a Two-Stage Self-Correction Loop with Structured Output (SLSO) Frameworkcited by 0

50 most cited of 64 All 64 (JSON)