mlsanityData to 7 Oct 2026

EgoExo-Next:Benchmarking Vision-Language Models on Visual-Option Next-State and Cross-View Reasoning

arXiv 2610.04506 ↗First posted 3 Oct 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning also fits: Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-language models (VLMs) are increasingly evaluated for egocentric and cross-view video reasoning, yet existing benchmarks largely focus on semantic event understanding, temporal relations, or correspondence between already observed views, leaving their ability to reason directly about future visual states underexplored. We introduce EgoExo-Next, a visual-option benchmark for dynamic visual-state reasoning, where models must identify how an observed action trajectory subsequently appears rather than predict only an action label or textual description. EgoExo-Next contains 2,503 human-curated four-choice questions from six public egocentric and ego--exo video sources and comprises four interconnected subtasks that evaluate egocentric next-state prediction, bidirectional ego--exo state correspondence, exocentric next-state prediction, and their composition in Ego-to-Exo Next-State. Extensive evaluation of proprietary, open-source, and spatial reasoning VLMs reveals a substantial human--model gap, with the best model achieving 43.81% average accuracy compared with 98.55% for humans, and the largest degradation occurring on the composed Ego-to-Exo task. These results suggest that current VLMs remain substantially limited in dynamic visual-state reasoning, particularly when temporal progression and cross-view reasoning must be composed. The benchmark is publicly available at urlhttps://huggingface.co/datasets/yutongli2024/EgoExo-Next.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. First posted on arXiv 3 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EgoExoBench: A Benchmark for First- and Third-person View Video Understanding in MLLMs
  2. 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoning
  3. 2026EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding
  4. 2026EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs
  5. 2026EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding
  6. 2026EgoExoMem: Cross-View Memory Reasoning over Synchronized Egocentric and Exocentric Videos
  7. 2026Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding
  8. 2026OmniEgo-R2: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026