mlsanityData to 7 Oct 2026

LightHouse: A Survey of AGI Hallucination

arXiv 2401.06792 ↗First posted 8 Jan 2024cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

With the development of artificial intelligence, large-scale models have become increasingly intelligent. However, numerous studies indicate that hallucinations within these large models are a bottleneck hindering the development of AI research. In the pursuit of achieving strong artificial intelligence, a significant volume of research effort is being invested in the AGI (Artificial General Intelligence) hallucination research. Previous explorations have been conducted in researching hallucinations within LLMs (Large Language Models). As for multimodal AGI, research on hallucinations is still in an early stage. To further the progress of research in the domain of hallucinatory phenomena, we present a bird's eye view of hallucinations in AGI, summarizing the current work on AGI hallucinations and proposing some directions for future research.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 78 of its 104 references that are in the map. First posted on arXiv 8 Jan 2024.

Builds on

78 of 104 references.

References · 78

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2017Deep reinforcement learning from human preferencescited by 3,846
  9. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  10. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  11. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  12. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
38 more
  1. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  2. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
  3. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  4. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  5. 2023LIMA: Less Is More for Alignmentcited by 1,080
  6. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
  7. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 729
  8. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
  9. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  10. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  11. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
  12. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  13. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
  14. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 368
  15. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  16. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 298
  17. 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 293
  18. 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 284
  19. 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 223
  20. 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 222
  21. 2023Listen, Think, and Understandcited by 206
  22. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 204
  23. 2023Mitigating the Alignment Tax of RLHFcited by 181
  24. 2023LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examplescited by 177
  25. 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
  26. 2023Macaw-LLM: Multi-Modal Language Modeling with Image, Audio, Video, and Text Integrationcited by 168
  27. 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 167
  28. 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 137
  29. 2022Training Data Influence Analysis and Estimation: A Surveycited by 134
  30. 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 119
  31. 2023Large Language Models as Generalizable Policies for Embodied Taskscited by 86
  32. 2023LP-MusicCaps: LLM-Based Pseudo Music Captioningcited by 83
  33. 2023Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approachcited by 79
  34. 2023Mitigating Fine-Grained Hallucination by Fine-Tuning Large Vision-Language Models with Caption Rewritescited by 61
  35. 2023TouchStone: Evaluating Vision-Language Models by Language Modelscited by 54
  36. 2023Putting People in Their Place: Affordance-Aware Human Insertion into Scenescited by 53
  37. 2023Post Hoc Explanations of Language Models Can Improve Language Modelscited by 50
  38. 2021Towards the Unification and Robustness of Perturbation and Gradient Based Explanationscited by 47

50 most cited of 78 All 78 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

  1. 2024A Survey on Large Language Model Hallucination via a Creativity Perspectivecited by 38
  2. 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoningcited by 33
  3. 2025Can Hallucinations Help? Boosting LLMs for Drug Discoverycited by 2
  4. 2025Valuable Hallucinations: Realizable Non-realistic Propositionscited by 0