TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
Video multimodal large language models (MLLMs) can describe what happens in a video, but rarely identify when the supporting evidence occurs. We study generalist video temporal grounding, in which one model predicts a variable-cardinality set of evidence intervals across video lengths, domains, query forms, and viewpoints. Existing training strategies are misaligned with this set-valued task: long-video labels often rely on brittle one-pass annotation, while reinforcement-learning rewards either fail to distinguish non-overlapping predictions or require fragile segment matching. TimeLens2 treats temporal evidence as an interval set throughout supervision and optimization. TimeLens2-93K constructs reliable multi-span supervision through caption-derived proposals, independent localization, cross-agent consensus, semantic verification, and boundary refinement. Our temporal Wasserstein reward computes exact one-dimensional (W1) between uniform distributions over merged interval supports, providing dense, matching-free feedback under unequal cardinalities and equivalent fragmentation; temporal IoU complements it with precise-overlap feedback. Across seven benchmarks, TimeLens2-2B outperforms all size-matched baselines on every benchmark, while the 4B and 8B variants achieve state-of-the-art performance, surpassing open-source models with up to 397B parameters. The 2B, 4B, and 8B variants improve over their Qwen3-VL backbones by 14.2, 13.0, and 18.1 mIoU points, respectively.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 45 of its 54 references that are in the map. First posted on arXiv 19 Jul 2026.
Builds on
45 of 54 references.
Closest ancestors · 12
Same direction, newest first
- 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation3 Feb
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning30 Jan
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding15 Jan
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec
- 2025TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning3 Dec
- 2025MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding27 May
- 2025Vidi: Large Multimodal Models for Video Understanding and Editing22 Apr
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Grounding17 Mar
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling31 Dec
- 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning25 Oct
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding4 Dec
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding5 Jun
Other references · 33
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
- 2025OpenAI GPT-5 System Cardcited by 910
- 2017Dense-Captioning Events in Videoscited by 789
- 2017Localizing Moments in Video with Natural Languagecited by 660
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2017TALL: Temporal Activity Localization via Language Querycited by 581
21 more
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 316
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
- 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2019Cross-task weakly supervised learning from instructional videoscited by 199
- 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
- 2021MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptionscited by 107
- 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 87
- 2021A Normalized Gaussian Wasserstein Distance for Tiny Object Detectioncited by 52
- 2026LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligencecited by 31
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiencycited by 25
- 2024Dual DETRs for Multi-Label Temporal Action Detectioncited by 18
- 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 18
- 2025MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrievalcited by 13
- 2025Tempo-R0: A Video-MLLM for Temporal Video Grounding through Efficient Temporal Sensing Reinforcement Learningcited by 9
- 2025Reasoning Guided Embeddings: Leveraging MLLM Reasoning for Improved Multimodal Retrievalcited by 9
- 2025VideoTG-R1: Boosting Video Temporal Grounding via Curriculum Reinforcement Learning on Reflected Boundary Annotationscited by 7
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoningcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025VideoITG: Multimodal Video Understanding with Instructed Temporal Grounding
- 2026Reinforcing Consistency in Video MLLMs with Structured Rewards
- 2026TimeThink: Reasoning with Time for Video LLMs
- 2025TimeExpert: An Expert-Guided Video LLM for Video Temporal Grounding
- 2026Conditional Multi-Event Temporal Grounding in Long-Form Video
- 2025TAR: Temporal Anchor-Constrained Reasoning for Video Temporal Grounding
- 2025Factorized Learning for Temporally Grounded Video-Language Models
- 2026Less from More: Reinforcing Sparse Video Reasoning from Dense References