mlsanityData to 7 Oct 2026

TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs

arXiv 2607.17423 ↗First posted 19 Jul 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Video multimodal large language models (MLLMs) can describe what happens in a video, but rarely identify when the supporting evidence occurs. We study generalist video temporal grounding, in which one model predicts a variable-cardinality set of evidence intervals across video lengths, domains, query forms, and viewpoints. Existing training strategies are misaligned with this set-valued task: long-video labels often rely on brittle one-pass annotation, while reinforcement-learning rewards either fail to distinguish non-overlapping predictions or require fragile segment matching. TimeLens2 treats temporal evidence as an interval set throughout supervision and optimization. TimeLens2-93K constructs reliable multi-span supervision through caption-derived proposals, independent localization, cross-agent consensus, semantic verification, and boundary refinement. Our temporal Wasserstein reward computes exact one-dimensional (W1) between uniform distributions over merged interval supports, providing dense, matching-free feedback under unequal cardinalities and equivalent fragmentation; temporal IoU complements it with precise-overlap feedback. Across seven benchmarks, TimeLens2-2B outperforms all size-matched baselines on every benchmark, while the 4B and 8B variants achieve state-of-the-art performance, surpassing open-source models with up to 397B parameters. The 2B, 4B, and 8B variants improve over their Qwen3-VL backbones by 14.2, 13.0, and 18.1 mIoU points, respectively.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 45 of its 54 references that are in the map. First posted on arXiv 19 Jul 2026.

Builds on

45 of 54 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation3 Feb
  2. 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning30 Jan
  3. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding15 Jan
  4. 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec
  5. 2025TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning3 Dec
  6. 2025MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding27 May
  7. 2025Vidi: Large Multimodal Models for Video Understanding and Editing22 Apr
  8. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Grounding17 Mar
  9. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling31 Dec
  10. 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning25 Oct
  11. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding4 Dec
  12. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding5 Jun

Other references · 33

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  6. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  7. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2017Dense-Captioning Events in Videoscited by 789
  10. 2017Localizing Moments in Video with Natural Languagecited by 660
  11. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
  12. 2017TALL: Temporal Activity Localization via Language Querycited by 581
21 more
  1. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  2. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  3. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 316
  4. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
  5. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
  6. 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
  7. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  8. 2019Cross-task weakly supervised learning from instructional videoscited by 199
  9. 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
  10. 2021MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptionscited by 107
  11. 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 87
  12. 2021A Normalized Gaussian Wasserstein Distance for Tiny Object Detectioncited by 52
  13. 2026LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligencecited by 31
  14. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiencycited by 25
  15. 2024Dual DETRs for Multi-Label Temporal Action Detectioncited by 18
  16. 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 18
  17. 2025MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrievalcited by 13
  18. 2025Tempo-R0: A Video-MLLM for Temporal Video Grounding through Efficient Temporal Sensing Reinforcement Learningcited by 9
  19. 2025Reasoning Guided Embeddings: Leveraging MLLM Reasoning for Improved Multimodal Retrievalcited by 9
  20. 2025VideoTG-R1: Boosting Video Temporal Grounding via Curriculum Reinforcement Learning on Reflected Boundary Annotationscited by 7
  21. 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025VideoITG: Multimodal Video Understanding with Instructed Temporal Grounding
  2. 2026Reinforcing Consistency in Video MLLMs with Structured Rewards
  3. 2026TimeThink: Reasoning with Time for Video LLMs
  4. 2025TimeExpert: An Expert-Guided Video LLM for Video Temporal Grounding
  5. 2026Conditional Multi-Event Temporal Grounding in Long-Form Video
  6. 2025TAR: Temporal Anchor-Constrained Reasoning for Video Temporal Grounding
  7. 2025Factorized Learning for Temporally Grounded Video-Language Models
  8. 2026Less from More: Reinforcing Sparse Video Reasoning from Dense References