How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
Not on the map. Why?
Abstract (arXiv)
While AI-generated hallucinations pose considerable risks, the underlying cognitive mechanisms by which humans can successfully recognize or be misled by these hallucinations remain unclear. To address this problem, this paper explores humans' neural dynamics to characterize how the brain processes hallucinated content. We record EEG signals from 27 participants while they are performing a verification task to judge the correctness of image descriptions generated by a multi-modal large language model (MLLM). Based on an averaged event-related potential (ERP) study, we reveal that multiple cognitive processes, e.g., semantic integration, inferential processing, memory retrieval, and cognitive load, exhibit distinct patterns when humans process hallucinated versus non-hallucinated content. Notably, neural responses to hallucinations that were misjudged versus correctly judged by human participants showed significant differences. This indicates that misjudged AI-generated hallucinations failed to trigger the standard neurocognitive fact verification pathway.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 57 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
28 of 57 references.
References · 28
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023A Survey of Large Language Modelscited by 2,576
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
- 2018Object Hallucination in Image Captioningcited by 669
- 2024Large Language Models: A Surveycited by 525
16 more
- 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 300
- 2023Multimodal Large Language Models: A Surveycited by 195
- 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Modelscited by 86
- 2022Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2cited by 55
- 2025Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistenciescited by 39
- 2022Toward cross-subject and cross-session generalization in EEG-based emotion recognition: Systematic review, taxonomy, and methodscited by 17
- 2021So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgementscited by 15
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memorycited by 14
- 2021Towards a Better Understanding Human Reading Comprehension with Brain Signalscited by 8
- 2023BrainLLM: Generative Language Decoding from Brain Recordingscited by 7
- 2026AEL: Evolving Agent Harness in Open-Ended Environmentscited by 6
- 2023Relevance Feedback with Brain Signalscited by 4
- 2026Steering the Verifiability of Multimodal AI Hallucinationscited by 4
- 2024CrossPT-EEG: A Benchmark for Cross-Participant and Cross-Time Generalization of EEG-based Visual Decodingcited by 3
- 2024Understanding the Effect of Opinion Polarization in Short Video Browsingcited by 2
- 2025I Think, Therefore I Hallucinate: Minds, Machines, and the Art of Being Wrongcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024AIGCs Confuse AI Too: Investigating and Explaining Synthetic Image-induced Hallucinations in Large Vision-Language Models
- 2025Investigating VLM Hallucination from a Cognitive Psychology Perspective: A First Step Toward Interpretation with Intriguing Observations
- 2025Triggering Hallucinations in LLMs: A Quantitative Study of Prompt-Induced Hallucination in Large Language Models
- 2024Interpreting and Mitigating Hallucination in MLLMs through Multi-agent Debate
- 2025INTER: Mitigating Hallucination in Large Vision-Language Models by Interaction Guidance Sampling
- 2025Chain-of-Thought Prompting Obscures Hallucination Cues in Large Language Models: An Empirical Evaluation
- 2025Auditing Meta-Cognitive Hallucinations in Reasoning Large Language Models
- 2026Attention Dispersion as a Diagnostic Signal for Hallucination in Large Language Models