mlsanityData to 7 Oct 2026

EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoning

arXiv 2603.09731 ↗First posted 10 Mar 2026cs.CV cs.AI cs.CLcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) are increasingly considered as a foundation for embodied agents, yet it remains unclear whether they can reliably reason about the long-term physical consequences of actions from an egocentric viewpoint. We study this gap through a new task, Egocentric Scene Prediction with LOng-horizon REasoning: given an initial-scene image and a sequence of atomic action descriptions, a model is asked to predict the final scene after all actions are executed. To enable systematic evaluation, we introduce EXPLORE-Bench, a benchmark curated from real first-person videos spanning diverse scenarios. Each instance pairs long action sequences with structured final-scene annotations, including object categories, visual attributes, and inter-object relations, which supports fine-grained, quantitative assessment. Experiments on a range of proprietary and open-source MLLMs reveal a significant performance gap to humans, indicating that long-horizon egocentric reasoning remains a major challenge. We further analyze test-time scaling via stepwise reasoning and show that decomposing long action sequences can improve performance to some extent, while incurring non-trivial computational overhead. Overall, EXPLORE-Bench provides a principled testbed for measuring and advancing long-horizon reasoning for egocentric embodied perception.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 62 of its 83 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

62 of 83 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models18 Dec
  2. 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT27 Oct
  3. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks27 Mar
  4. 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos16 Mar
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  6. 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning11 Dec

Other references · 56

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  10. 2024A Survey on LLM-as-a-Judgecited by 1,384
  11. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  12. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
38 more
  1. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
  2. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  3. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  4. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
  5. 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
  6. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  7. 2022Egocentric Video-Language Pretrainingcited by 231
  8. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 215
  9. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  10. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  11. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
  12. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
  13. 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 112
  14. 2025MiMo-VL Technical Reportcited by 106
  15. 2025Ovis2.5 Technical Reportcited by 103
  16. 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
  17. 2025EgoLife: Towards Egocentric Life Assistantcited by 86
  18. 2022Learning Affordance Grounding from Exocentric Imagescited by 82
  19. 2025Kwai Keye-VL 1.5 Technical Reportcited by 68
  20. 2023Open-Set Image Tagging with Multi-Grained Text Supervisioncited by 67
  21. 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
  22. 2023EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Modelscited by 59
  23. 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 58
  24. 2024Grounded Multi-Hop VideoQA in Long-Form Egocentric Videoscited by 43
  25. 2025EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question Answeringcited by 43
  26. 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spacescited by 33
  27. 2024Benchmarking Large Vision-Language Models via Directed Scene Graph for Comprehensive Image Captioningcited by 30
  28. 2026STEP3-VL-10B Technical Reportcited by 28
  29. 2024EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Viewscited by 26
  30. 2023Movie101: A New Movie Understanding Benchmarkcited by 25
  31. 2025EOC-Bench: Can MLLMs Identify, Recall, and Forecast Objects in an Egocentric World?cited by 20
  32. 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answeringcited by 19
  33. 2025ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition Benchmarkcited by 18
  34. 2025MobileWorldBench: Towards Semantic World Modeling For Mobile Agentscited by 18
  35. 2025HERO: Human Reaction Generation from Videoscited by 15
  36. 2025X-LeBench: A Benchmark for Extremely Long Egocentric Video Understandingcited by 14
  37. 2025ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interactioncited by 14
  38. 2025TeleEgo: Benchmarking Egocentric AI Assistants in the Wildcited by 9

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026EgoExo-Next:Benchmarking Vision-Language Models on Visual-Option Next-State and Cross-View Reasoning
  2. 2026Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding
  3. 2026From Frames to Temporal Graphs: In-Context Egocentric Action Recognition with Vision-Language Models
  4. 2026Vision-Language Models for Egocentric Video: From Hand-Object Interaction to Embodied AI
  5. 2024VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI
  6. 2026EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs
  7. 2026EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning
  8. 2026EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding