mlsanityData to 14 Oct 2026

EvoGround: Self-Evolving Video Agents for Video Temporal Grounding

arXiv 2605.13803 ↗First posted 13 May 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Video temporal grounding (VTG) takes an untrimmed video and a natural-language query as input and localizes the temporal moment that best matches the query. Existing methods rely on large, task-specific datasets requiring costly manual annotation. We introduce EvoGround, a framework of two coupled self-evolving agents, a proposer and a solver, that learn temporal grounding from raw videos without any human-labeled data. The proposer generates query--moment pairs from raw videos, while the solver learns to ground them and feeds back signals that improve the proposer in return. Through this self-reinforcing reinforcement-learning loop, the two agents are initialized from the same backbone and mutually improve across iterations. Trained on 2.5K unlabeled videos, EvoGround matches or surpasses fully supervised models across multiple VTG benchmarks, while emerging as a state-of-the-art fine-grained video captioner without manual labels.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 62 of its 69 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

62 of 69 references.

References · 62

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024Qwen2.5 Technical Reportcited by 4,942
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  9. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  10. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  11. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  12. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
38 more
  1. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  2. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  3. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  4. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  5. 2017Dense-Captioning Events in Videoscited by 793
  6. 2024Phi-4 Technical Reportcited by 711
  7. 2017TALL: Temporal Activity Localization via Language Querycited by 584
  8. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 542
  9. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  10. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
  11. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
  12. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  13. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 285
  14. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
  15. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
  16. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
  17. 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 229
  18. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
  19. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
  20. 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
  21. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  22. 2020Local-Global Video-Text Interactions for Temporal Groundingcited by 188
  23. 2020Dense Regression Network for Video Groundingcited by 176
  24. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
  25. 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 135
  26. 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
  27. 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
  28. 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuningcited by 106
  29. 2024TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Modelscited by 97
  30. 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 91
  31. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 89
  32. 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 86
  33. 2024VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Groundingcited by 85
  34. 2024Matryoshka Multimodal Modelscited by 84
  35. 2024TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Modelscited by 73
  36. 2024E.T. Bench: Towards Open-Ended Event-Level Video-Language Understandingcited by 70
  37. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
  38. 2020Uncovering Hidden Challenges in Query-Based Video Moment Retrievalcited by 58

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.