LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding
Not on the map. Why?
Abstract (arXiv)
This paper addresses the critical and underexplored challenge of long video understanding with low computational budgets. We propose LongVideo-R1, an active, reasoning-equipped multimodal large language model (MLLM) agent designed for efficient video context navigation, avoiding the redundancy of exhaustive search. At the core of LongVideo-R1 lies a reasoning module that leverages high-level visual cues to infer the most informative video clip for subsequent processing. During inference, the agent initiates traversal from top-level visual summaries and iteratively refines its focus, immediately halting the exploration process upon acquiring sufficient knowledge to answer the query. To facilitate training, we first extract hierarchical video captions from CGBench, a video corpus with grounding annotations, and guide GPT-5 to generate 33K high-quality chain-of-thought-with-tool trajectories. The LongVideo-R1 agent is fine-tuned upon the Qwen-3-8B model through a two-stage paradigm: supervised fine-tuning (SFT) followed by reinforcement learning (RL), where RL employs a specifically designed reward function to maximize selective and efficient clip navigation. Experiments on multiple long video benchmarks validate the effectiveness of name, which enjoys superior tradeoff between QA accuracy and efficiency. All curated data and source code are provided in the supplementary material and will be made publicly available. Code and data are available at: https://github.com/qiujihao19/LongVideo-R1
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 54 of its 62 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
54 of 62 references.
References · 54
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
38 more
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2025Group Sequence Policy Optimizationcited by 788
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 242
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
- 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 157
- 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
- 2024Aria: An Open Multimodal Native Mixture-of-Experts Modelcited by 136
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 111
- 2025Geometric-Mean Policy Optimizationcited by 107
- 2024Video-CCAM: Enhancing Video-Language Understanding with Causal Cross-Attention Masks for Short and Long Videoscited by 95
- 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 82
- 2025VideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videoscited by 76
- 2024MovieChat+: Question-aware Sparse Memory for Long Video Question Answeringcited by 73
- 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
- 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
- 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
- 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
- 2025AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understandingcited by 45
- 2024Don't Look Twice: Faster Video Transformers with Run-Length Tokenizationcited by 42
- 2024TempMe: Video Temporal Token Merging for Efficient Text-Video Retrievalcited by 39
- 2024ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understandingcited by 33
- 2024Artemis: Towards Referential Understanding in Complex Videoscited by 25
- 2024ChatterBox: Multi-round Multimodal Referring and Groundingcited by 24
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2026Agentic Active Omni-Modal Perception for Multi-Hop Audio-Visual Reasoningcited by 2
- 2026ShallowStream: Index Shallow then Answer Deep for Streaming Video Understandingcited by 2
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Frame Differential On-Policy Self-Distillation for Video Reasoningcited by 0
- 2026FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answeringcited by 0
- 2026FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering30 Sep 2026
- 2026Frame Differential On-Policy Self-Distillation for Video Reasoning30 Sep 2026
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding2 Sep 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026Agentic Active Omni-Modal Perception for Multi-Hop Audio-Visual Reasoning27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning
- 2025Video-QTR: Query-Driven Temporal Reasoning Framework for Lightweight Video Understanding
- 2025EEA: Exploration-Exploitation Agent for Long Video Understanding
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoning
- 2026VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning
- 2025GCAgent: Long-Video Understanding via Schematic and Narrative Episodic Memory
- 2023Long Video Understanding with Learnable Retrieval in Video-Language Models