EVA: Efficient Reinforcement Learning for End-to-End Video Agent
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
also in 2 more
Abstract (arXiv)
Video understanding with multimodal large language models (MLLMs) remains challenging due to the long token sequences of videos, which contain extensive temporal dependencies and redundant frames. Existing approaches typically treat MLLMs as passive recognizers, processing entire videos or uniformly sampled frames without adaptive reasoning. Recent agent-based methods introduce external tools, yet still depend on manually designed workflows and perception-first strategies, resulting in inefficiency on long videos. We present EVA, an Efficient Reinforcement Learning framework for End-to-End Video Agent, which enables planning-before-perception through iterative summary-plan-action-reflection reasoning. EVA autonomously decides what to watch, when to watch, and how to watch, achieving query-driven and efficient video understanding. To train such agents, we design a simple yet effective three-stage learning pipeline - comprising supervised fine-tuning (SFT), Kahneman-Tversky Optimization (KTO), and Group Relative Policy Optimization (GRPO) - that bridges supervised imitation and reinforcement learning. We further construct high-quality datasets for each stage, supporting stable and reproducible training. We evaluate EVA on six video understanding benchmarks, demonstrating its comprehensive capabilities. Compared with existing baselines, EVA achieves a substantial improvement of 6-12% over general MLLM baselines and a further 1-3% gain over prior adaptive agent methods.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 41 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
36 of 41 references.
Closest ancestors · 12
Same direction, newest first
- 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning27 Oct
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting29 Sep
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025Does Your Vision-Language Model Get Lost in the Long Video Sampling Dilemma?16 Mar
- 2025Adaptive Keyframe Sampling for Long Video Understanding28 Feb
- 2025M-LLM Based Video Frame Selection for Efficient Video Understanding27 Feb
- 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understanding16 Dec
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videos19 Aug
- 2024Long Context Transfer from Language to Vision24 Jun
- 2024LVBench: An Extreme Long Video Understanding Benchmark12 Jun
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding18 Mar
Other references · 24
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
12 more
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 197
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 97
- 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 68
- 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 49
- 2025Video-MTR: Reinforced Multi-Turn Reasoning for Long Video Understandingcited by 28
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoningcited by 27
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1cited by 25
- 2024Depending on yourself when you should: Mentoring LLM with RL agents to become the master in cybersecurity gamescited by 20
- 2025TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement Learningcited by 20
- 2025ELV-Halluc: Benchmarking Semantic Aggregation Hallucinations in Long Video Understandingcited by 10
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learningcited by 2
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understandingcited by 2
- 2026Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Modelscited by 0
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolutioncited by 0
- 2026Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoningcited by 0
- 2026Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoning2 Oct 2026
- 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolution29 Sep 2026
- 2026Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models24 Sep 2026
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understanding21 Aug 2026
- 2026MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learning14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024Adaptive Video Understanding Agent: Enhancing efficiency with dynamic frame sampling and feedback-driven reasoning
- 2025VideoChat-M1: Collaborative Policy Planning for Video Understanding via Multi-Agent Reinforcement Learning
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understanding
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
- 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
- 2026Weaver: End-to-End Agentic System Training for Video Interleaved Reasoning
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding