mlsanityData to 14 Oct 2026

EGOILLUSION: Benchmarking Hallucinations in Egocentric Video Understanding

arXiv 2508.12687 ↗First posted 18 Aug 2025cs.AI cs.CVcited by 10

On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in complex multimodal tasks. While MLLMs excel at visual perception and reasoning in third-person and egocentric videos, they are prone to hallucinations, generating coherent yet inaccurate responses. We present EgoIllusion, a first benchmark to evaluate MLLM hallucinations in egocentric videos. EgoIllusion comprises 1,400 videos paired with 8,000 human-annotated open and closed-ended questions designed to trigger hallucinations in both visual and auditory cues in egocentric videos. Evaluations across ten MLLMs reveal significant challenges, including powerful models like GPT-4o and Gemini, achieving only 59% accuracy. EgoIllusion lays the foundation in developing robust benchmarks to evaluate the effectiveness of MLLMs and spurs the development of better egocentric MLLMs with reduced hallucination rates. Our benchmark will be open-sourced for reproducibility.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 32 of its 43 references that are in the map. First posted on arXiv 18 Aug 2025.

Builds on

32 of 43 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Models24 Jun
  2. 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluation13 Nov
  3. 2023Holistic Analysis of Hallucination in GPT-4V(ision): Bias and Interference Challenges6 Nov

Other references · 29

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  6. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  7. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  8. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  9. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  10. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  11. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
  12. 2020Rescaling Egocentric Visioncited by 540
17 more
  1. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
  2. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  3. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  4. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 211
  5. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 153
  6. 2023VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Datasetcited by 140
  7. 2024Video ReCap: Recursive Captioning of Hour-Long Videoscited by 89
  8. 2023Grounded Question-Answering in Long Egocentric Videoscited by 64
  9. 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videoscited by 32
  10. 2022Visual Object Tracking in First Person Visioncited by 25
  11. 2024From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generationcited by 23
  12. 2024Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videoscited by 21
  13. 2023The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspectivecited by 14
  14. 2024Multimodal Cross-Domain Few-Shot Learning for Egocentric Action Recognitioncited by 14
  15. 2015Compact CNN for Indexing Egocentric Videoscited by 9
  16. 2023Encode-Store-Retrieve: Augmenting Human Memory through Language-Encoded Egocentric Perceptioncited by 9
  17. 2023EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge: Mixed Sequences Predictioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 9.

10 papers.

  1. 2025EgoVITA: Learning to Plan and Verify for Egocentric Video Reasoningcited by 4
  2. 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understandingcited by 4
  3. 2026EgoAVU: Egocentric Audio-Visual Understandingcited by 3
  4. 2026Egocentric Co-Pilot: Web-Native Smart-Glasses Agents for Assistive Egocentric AIcited by 3
  5. 2026GameplayQA: A Benchmarking Framework for Decision-Dense POV-Synced Multi-Video Understanding of 3D Virtual Agentscited by 3
  6. 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videoscited by 2
  7. 2026Do Vision Language Models Need to Process Image Tokens?cited by 1
  8. 2026Distorted or Fabricated? A Survey on Hallucination in Video LLMscited by 1
  9. 2026CCTVBench: Contrastive Consistency Traffic VideoQA Benchmark for Multimodal LLMscited by 1
  10. 2026Exploring Audio Hallucination in Egocentric Video Understandingcited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2024VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understanding
  2. 2025ELV-Halluc: Benchmarking Semantic Aggregation Hallucinations in Long Video Understanding
  3. 2024AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models
  4. 2024Measuring the Measurers: Quality Evaluation of Hallucination Benchmarks for Large Vision-Language Models
  5. 2025MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM
  6. 2024Hallucination of Multimodal Large Language Models: A Survey
  7. 2024Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluations
  8. 2024Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning