Interpretable Temporal Video Reasoning with EventGraph and EventField
Not on the map. Why?
Abstract (arXiv)
We present a structured temporal video reasoning pipeline built around a discrete EventGraph, a continuous EventField, and a human-readable EventGlyph view. On a calibrated EPIC-KITCHENS subset of 10 videos and 50 temporal reasoning questions, EventField+Glyph achieves 0.98 overall accuracy, which is higher than the caption baseline by +0.40 (paired p = 1.1 × 10-5) and direct VLM-only QA by +0.20 (p = 0.0063) on this subset. We further evaluate annotation-source variations, including manual, heuristic, and heuristic+Gemini pipelines, and find that the best structured method stays above the caption baseline across settings. We also include cross-video pair benchmarking and an appendix gallery of glyph outputs for all studied videos. Overall, the results indicate that structured temporal representations can support both performance and inspectability by preserving symbolic structure, capturing temporal continuity, and providing human-readable diagnostics for video reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
10 of 16 references.
References · 10
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2016The Mythos of Model Interpretabilitycited by 721
- 2020Rescaling Egocentric Visioncited by 540
- 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
- 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
- 2018Videos as Space-Time Region Graphscited by 221
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 135
- 2021AGQA: A Benchmark for Compositional Spatio-Temporal Reasoningcited by 120
- 2024MoReVQA: Exploring Modular Reasoning Models for Video Question Answeringcited by 74
- 2023Grounded Question-Answering in Long Egocentric Videoscited by 64
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events
- 2025RTime-QA: A Benchmark for Atomic Temporal Event Understanding in Large Multi-modal Models
- 2025TimeLogic: A Temporal Logic Benchmark for Video QA
- 2026EventLens: Event-Structure Reinforcement Learning for Video Understanding
- 2026GraphThinker: Reinforcing Temporally Grounded Video Reasoning with Event Graph Thinking
- 2024TemporalVLM: Video LLMs for Temporal Reasoning in Long Videos
- 2026TimeBlind: A Spatio-Temporal Compositionality Benchmark for Video LLMs
- 2026Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning