mlsanityData to 13 Oct 2026

Incentivizing Temporal-Awareness in Egocentric Video Understanding Models

arXiv 2603.27184 ↗First posted 28 Mar 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Multimodal large language models (MLLMs) have recently shown strong performance in visual understanding, yet they often lack temporal awareness, particularly in egocentric settings where reasoning depends on the correct ordering and evolution of events. This deficiency stems in part from training objectives that fail to explicitly reward temporal reasoning and instead rely on frame-level spatial shortcuts. To address this limitation, we propose Temporal Global Policy Optimization (TGPO), a reinforcement learning with verifiable rewards (RLVR) algorithm designed to incentivize temporal awareness in MLLMs. TGPO contrasts model outputs generated from temporally ordered versus shuffled video frames to derive calibrated, globally normalized reward signals that explicitly favor temporally coherent reasoning. Integrated with GRPO and GSPO, TGPO supports cold-start RL training and effectively suppresses spatial shortcut behaviors learned by existing MLLMs. Experiments across five egocentric video benchmarks demonstrate that TGPO consistently improves temporal grounding and causal coherence, outperforming prior RL-based video reasoning approaches. Our results suggest that TGPO offers a simple and scalable pathway toward temporally robust MLLMs for egocentric video understanding.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 34 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

24 of 34 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  2. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Grounding17 Mar

Other references · 22

  1. 2022Training language models to follow instructions with human feedbackcited by 15,856
  2. 2017Proximal Policy Optimization Algorithmscited by 14,592
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,831
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,692
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,003
  7. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,535
  8. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 760
  9. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 672
  10. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 567
  11. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 311
  12. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 250
10 more
  1. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 236
  2. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  3. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
  4. 2024EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptationcited by 44
  5. 2025Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videoscited by 42
  6. 2024MM-Ego: Towards Building Egocentric Multimodal LLMs for Video QAcited by 24
  7. 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
  8. 2025Breaking Down Video LLM Benchmarks: Knowledge, Spatial Perception, or True Temporal Understanding?cited by 19
  9. 2025EgoVLM: Policy Optimization for Egocentric Video Understandingcited by 11
  10. 2025EgoVITA: Learning to Plan and Verify for Egocentric Video Reasoningcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos
  2. 2025EgoExo-Con: Exploring View-Invariant Video Temporal Understanding
  3. 2025TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning
  4. 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning
  5. 2026Visually-Guided Policy Optimization for Multimodal Reasoning
  6. 2026Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
  7. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  8. 2026Temporal-Aware Reasoning Optimization for Video Temporal Grounding