mlsanityData to 7 Oct 2026

GraphThinker: Reinforcing Temporally Grounded Video Reasoning with Event Graph Thinking

arXiv 2602.17555 ↗First posted 19 Feb 2026cs.CVcited by 5

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Video reasoning requires a fine-grained understanding of the temporal dependencies and event-level relations between objects and events in videos. Current Multimodal Large Language Models (MLLMs) are prone to severe temporal hallucinations in video reasoning. An underlying cause of these hallucinations is weak visual-temporal grounding and the lack of explicit structure for modelling event relations. Models often rely on auxiliary text, such as dense captions, rather than explicitly anchoring their reasoning in actual visual evidence. However, these textual representations are inherently unstructured and fail to provide explicit causal constraints needed to guide the model's reasoning. In this work, we propose GraphThinker, a reinforcement finetuning method that constructs a structured event representation of a video and enforces visual grounding to jointly reduce reasoning hallucinations. Specifically, we employ an MLLM to construct an Event-based Video Scene Graph (EVSG) that captures both intra- and inter-event relations, guiding a structured video reasoning process. Moreover, we address the weak grounding issue by introducing a novel visual attention reward during reinforcement finetuning that encourages the model to actively attend to reliable visual cues. On the RexTime dataset, GraphThinker achieves an over 4% improvement in IoU=0.3 for moment localisation. On the VidHalluc dataset, GraphThinker achieves a 9.8% improvement in reducing temporal sequence hallucination and a 7.6% gain in Binary QA in reducing action hallucination, compared to the state-of-the-art methods.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 67 of its 78 references that are in the map. First posted on arXiv 19 Feb 2026.

Builds on

67 of 78 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025VTimeCoT: Thinking by Drawing for Video Temporal Grounding and Reasoning16 Oct
  2. 2025Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Models15 Sep
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  4. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
  5. 2025Towards Video Thinking Test: A Holistic Benchmark for Advanced Video Reasoning and Understanding20 Jul
  6. 2025Scaling RL to Long Videos10 Jul
  7. 2025Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thought10 Jun
  8. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency2 Jun
  9. 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoning31 May
  10. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
  11. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  12. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
7 more
  1. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  2. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning14 Mar
  3. 2024STEP: Enhancing Video-LLMs' Compositional Reasoning by Spatio-Temporal Graph-guided Self-Training29 Nov
  4. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection22 Nov
  5. 2024Temporal Reasoning Transfer from Text to Video8 Oct
  6. 2024ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videos27 Jun
  7. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May

Other references · 48

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  4. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  5. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  6. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  7. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  8. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  9. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  10. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  11. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  12. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
36 more
  1. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
  2. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
  3. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 368
  4. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
  5. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
  6. 2019Action Genome: Actions as Composition of Spatio-temporal Scene Graphscited by 249
  7. 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
  8. 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understandingcited by 180
  9. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
  10. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  11. 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 133
  12. 2024LITA: Language Instructed Temporal-Localization Assistantcited by 124
  13. 2021Spatial-Temporal Transformer for Dynamic Scene Graph Generationcited by 95
  14. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
  15. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
  16. 2024Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Modelscited by 67
  17. 2024VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understandingcited by 65
  18. 2025Embodied AI Agents: Modeling the Worldcited by 57
  19. 2022Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuningcited by 54
  20. 2023Panoptic Video Scene Graph Generationcited by 46
  21. 2025SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Rewardcited by 45
  22. 2024From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Modelscited by 43
  23. 2023Unbiased Scene Graph Generation in Videoscited by 38
  24. 2025PerturboLLaVA: Reducing Multimodal Hallucinations with Perturbative Visual Trainingcited by 37
  25. 2024Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrievalcited by 36
  26. 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
  27. 2023HIG: Hierarchical Interlacement Graph Approach to Scene Graph Generation in Video Understandingcited by 21
  28. 2025Building a Mind Palace: Structuring Environment-Grounded Semantic Graphs for Effective Long Video Analysis with LLMscited by 19
  29. 2024HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipationcited by 17
  30. 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoningcited by 15
  31. 2024SportsHHI: A Dataset for Human-Human Interaction Detection in Sports Videoscited by 14
  32. 2025Dr.V: A Hierarchical Perception-Temporal-Cognition Framework to Diagnose Video Hallucination by Fine-grained Spatial-Temporal Groundingcited by 13
  33. 2024Question-Answering Dense Video Eventscited by 11
  34. 2025MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Groundingcited by 11
  35. 2025ZoomV: Temporal Zoom-in for Efficient Long Video Understandingcited by 10
  36. 2025TOGA: Temporally Grounded Open-Ended Video QA with Weak Supervisioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Video Finetuning Improves Reasoning Between Frames
  2. 2023Look, Remember and Reason: Grounded reasoning in videos with language models
  3. 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
  4. 2026Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events
  5. 2026TimeThink: Reasoning with Time for Video LLMs
  6. 2025TAR: Temporal Anchor-Constrained Reasoning for Video Temporal Grounding
  7. 2025VCRBench: Exploring Long-form Causal Reasoning Capabilities of Large Video Language Models
  8. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting