EvoGround: Self-Evolving Video Agents for Video Temporal Grounding
Not on the map. Why?
Abstract (arXiv)
Video temporal grounding (VTG) takes an untrimmed video and a natural-language query as input and localizes the temporal moment that best matches the query. Existing methods rely on large, task-specific datasets requiring costly manual annotation. We introduce EvoGround, a framework of two coupled self-evolving agents, a proposer and a solver, that learn temporal grounding from raw videos without any human-labeled data. The proposer generates query--moment pairs from raw videos, while the solver learns to ground them and feeds back signals that improve the proposer in return. Through this self-reinforcing reinforcement-learning loop, the two agents are initialized from the same backbone and mutually improve across iterations. Trained on 2.5K unlabeled videos, EvoGround matches or surpasses fully supervised models across multiple VTG benchmarks, while emerging as a state-of-the-art fine-grained video captioner without manual labels.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 62 of its 69 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
62 of 69 references.
References · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
38 more
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2017Dense-Captioning Events in Videoscited by 793
- 2024Phi-4 Technical Reportcited by 711
- 2017TALL: Temporal Activity Localization via Language Querycited by 584
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 542
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
- 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 285
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
- 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
- 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 229
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
- 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
- 2020Local-Global Video-Text Interactions for Temporal Groundingcited by 188
- 2020Dense Regression Network for Video Groundingcited by 176
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 135
- 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
- 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
- 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuningcited by 106
- 2024TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Modelscited by 97
- 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 91
- 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 89
- 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 86
- 2024VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Groundingcited by 85
- 2024Matryoshka Multimodal Modelscited by 84
- 2024TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Modelscited by 73
- 2024E.T. Bench: Towards Open-Ended Event-Level Video-Language Understandingcited by 70
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
- 2020Uncovering Hidden Challenges in Query-Based Video Moment Retrievalcited by 58
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervisioncited by 1
- 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolutioncited by 0
- 2026CoEvoWhen: Policy-Tool Coevolution for Ultra-Long Video Temporal Groundingcited by 0
- 2026VideoEvolve: Evolving Agent Harnesses for Video Temporal Groundingcited by 0
- 2026VideoEvolve: Evolving Agent Harnesses for Video Temporal Grounding1 Oct 2026
- 2026CoEvoWhen: Policy-Tool Coevolution for Ultra-Long Video Temporal Grounding30 Sep 2026
- 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolution29 Sep 2026
- 2026Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision3 Sep 2026