LifeEval: A Multimodal Benchmark for Assistive AI in Egocentric Daily Life Tasks
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
The rapid progress of Multimodal Large Language Models (MLLMs) marks a significant step toward artificial general intelligence, offering great potential for augmenting human capabilities. However, their ability to provide effective assistance in dynamic, real-world environments remains largely underexplored. Existing video benchmarks predominantly assess passive understanding through retrospective analysis or isolated perception tasks, failing to capture the interactive and adaptive nature of real-time user assistance. To bridge this gap, we introduce LifeEval, a multimodal benchmark designed to evaluate real-time, task-oriented human-AI collaboration in daily life from an egocentric perspective. LifeEval emphasizes three key aspects: task-oriented holistic evaluation, egocentric real-time perception from continuous first-person streams, and human-assistant collaborative interaction through natural dialogues. Constructed via a rigorous annotation pipeline, the benchmark comprises 4,075 high-quality question-answer pairs across 6 core capability dimensions. Extensive evaluations of 26 state-of-the-art MLLMs on LifeEval reveal substantial challenges in achieving timely, effective and adaptive interaction, highlighting essential directions for advancing human-centered interactive intelligence.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 53 references that are in the map. First posted on arXiv 28 Feb 2026.
Builds on
39 of 53 references.
Closest ancestors · 4
Same direction, newest first
- 2025EOC-Bench: Can MLLMs Identify, Recall, and Forecast Objects in an Egocentric World?5 Jun
- 2025ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition Benchmark9 Jan
- 2024EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios5 Dec
- 2024VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI15 Oct
Other references · 35
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
23 more
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2024Long Context Transfer from Language to Visioncited by 515
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
- 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 211
- 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understandingcited by 182
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 166
- 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
- 2016Visual Question Answering: A Survey of Methods and Datasetscited by 123
- 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 115
- 2024HourVideo: 1-Hour Video-Language Understandingcited by 113
- 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 69
- 2025SVBench: A Benchmark with Temporal Multi-Turn Dialogues for Streaming Video Understandingcited by 57
- 2025OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contextscited by 51
- 2025EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question Answeringcited by 44
- 2025Towards Video Thinking Test: A Holistic Benchmark for Advanced Video Reasoning and Understandingcited by 24
- 2025VideoLucy: Deep Memory Backtracking for Long Video Understandingcited by 22
- 2025Challenges and Trends in Egocentric Vision: A Surveycited by 20
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026LightMem-Ego: Your AI Memory for Everyday Lifecited by 4
- 2026OmniAssistBench: Assistant-style Interaction Benchmark for Omni-LLMscited by 0
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalizationcited by 0
- 2026EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videoscited by 0
- 2026EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactionscited by 0
- 2026EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions13 Oct 2026
- 2026EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos30 Sep 2026
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization17 Sep 2026
- 2026OmniAssistBench: Assistant-style Interaction Benchmark for Omni-LLMs21 Aug 2026
- 2026LightMem-Ego: Your AI Memory for Everyday Life13 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025HumanSense: From Multimodal Perception to Empathetic Context-Aware Responses through Reasoning MLLMs
- 2025EmbodiedEval: Evaluate Multimodal LLMs as Embodied Agents
- 2026EgoArgus: Benchmarking VLMs as Situational Assistants for Modality-Grounded User Supports
- 2026Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications
- 2026Time-Aware Assistive Navigation
- 2023EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models
- 2025HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interaction
- 2026Egocentric Co-Pilot: Web-Native Smart-Glasses Agents for Assistive Egocentric AI