Distorted or Fabricated? A Survey on Hallucination in Video LLMs
Not on the map. Why?
Abstract (arXiv)
Despite significant progress in video-language modeling, hallucinations remain a persistent challenge in Video Large Language Models (Vid-LLMs), referring to outputs that appear plausible yet contradict the content of the input video. This survey presents a comprehensive analysis of hallucinations in Vid-LLMs and introduces a systematic taxonomy that categorizes them into two core types: dynamic distortion and content fabrication, each comprising two subtypes with representative cases. Building on this taxonomy, we review recent advances in the evaluation and mitigation of hallucinations, covering key benchmarks, metrics, and intervention strategies. We further analyze the root causes of dynamic distortion and content fabrication, which often result from limited capacity for temporal representation and insufficient visual grounding. These insights inform several promising directions for future work, including the development of motion-aware visual encoders and the integration of counterfactual learning techniques. This survey consolidates scattered progress to foster a systematic understanding of hallucinations in Vid-LLMs, laying the groundwork for building robust and reliable video-language systems. An up-to-date curated list of related works is maintained at https://github.com/hukcc/Awesome-Video-Hallucination .
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
38 of 49 references.
References · 38
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 310
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 231
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
- 2024A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Modelscited by 98
- 2024VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Modelscited by 88
- 2024Vript: A Video Is Worth Thousands of Wordscited by 71
26 more
- 2023Vista-LLaMA: Reducing Hallucination in Video Language Models via Equal Distance to Visual Tokenscited by 70
- 2024VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understandingcited by 65
- 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 58
- 2024EventHallusion: Diagnosing Event Hallucinations in Video LLMscited by 55
- 2024The Curse of Multi-Modalities: Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audiocited by 48
- 2025VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations on Synthetic Video Understandingcited by 32
- 2025AVCD: Mitigating Hallucinations in Audio-Visual Large Language Models through Contrastive Decodingcited by 26
- 2025MASH-VLM: Mitigating Action-Scene Hallucination in Video-LLMs through Disentangled Spatial-Temporal Representationscited by 22
- 2023Models See Hallucinations: Evaluating the Factuality in Video Captioningcited by 19
- 2024VidHal: Benchmarking Temporal Hallucinations in Vision LLMscited by 19
- 2025RoadSocial: A Diverse VideoQA Dataset and Benchmark for Road Event Understanding from Social Video Narrativescited by 15
- 2025PaMi-VDPO: Mitigating Video Hallucinations by Prompt-Aware Multi-Instance Video Preference Learningcited by 15
- 2025VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Modelscited by 14
- 2025EGOILLUSION: Benchmarking Hallucinations in Egocentric Video Understandingcited by 10
- 2025ELV-Halluc: Benchmarking Semantic Aggregation Hallucinations in Long Video Understandingcited by 10
- 2025Flow4Agent: Long-form Video Understanding via Motion Prior from Optical Flowcited by 9
- 2025SmartSight: Mitigating Hallucination in Video-LLMs Without Compromising Video Understanding via Temporal Attention Collapsecited by 9
- 2025SEASON: Mitigating Temporal Hallucination in Video Large Language Models via Self-Diagnostic Contrastive Decodingcited by 8
- 2024Bias-Conflict Sample Synthesis and Adversarial Removal Debias Strategy for Temporal Sentence Grounding in Videocited by 7
- 2025Mitigating Hallucination in VideoLLMs via Temporal-Aware Activation Engineeringcited by 7
- 2025VideoPerceiver: Enhancing Fine-Grained Temporal Perception in Video Multimodal Large Language Modelscited by 5
- 2024Aligning Audio-Visual Joint Representations with an Agentic Workflowcited by 4
- 2025Taming Hallucinations: Boosting MLLMs' Video Understanding via Counterfactual Video Generationcited by 4
- 2025MESH -- Understanding Videos Like Human: Measuring Hallucinations in Large Video Modelscited by 2
- 2025Image-to-Video Transfer Learning based on Image-Language Foundation Models: A Comprehensive Surveycited by 2
- 2025Mitigating Object and Action Hallucinations in Multimodal LLMs via Self-Augmented Contrastive Alignmentcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.