ChronoForge-RL: Chronological Forging through Reinforcement Learning for Enhanced Video Understanding
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Current state-of-the-art video understanding methods typically struggle with two critical challenges: (1) the computational infeasibility of processing every frame in dense video content and (2) the difficulty in identifying semantically significant frames through naive uniform sampling strategies. In this paper, we propose a novel video understanding framework, called ChronoForge-RL, which combines Temporal Apex Distillation (TAD) and KeyFrame-aware Group Relative Policy Optimization (KF-GRPO) to tackle these issues. Concretely, we introduce a differentiable keyframe selection mechanism that systematically identifies semantic inflection points through a three-stage process to enhance computational efficiency while preserving temporal information. Then, two particular modules are proposed to enable effective temporal reasoning: Firstly, TAD leverages variation scoring, inflection detection, and prioritized distillation to select the most informative frames. Secondly, we introduce KF-GRPO which implements a contrastive learning paradigm with a saliency-enhanced reward mechanism that explicitly incentivizes models to leverage both frame content and temporal relationships. Finally, our proposed ChronoForge-RL achieves 69.1% on VideoMME and 52.7% on LVBench compared to baseline methods, clearly surpassing previous approaches while enabling our 7B parameter model to achieve performance comparable to 72B parameter alternatives.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 18 of its 25 references that are in the map. First posted on arXiv 19 Sep 2025.
Builds on
18 of 25 references.
References · 18
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 356
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 213
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 197
- 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 167
6 more
- 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 159
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 98
- 2025AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understandingcited by 48
- 2025Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillationcited by 37
- 2024Dynamic-VLM: Simple Dynamic Visual Token Compression for VideoLLMcited by 32
- 2025QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehensioncited by 21
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement Learning
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2026Incentivizing Temporal-Awareness in Egocentric Video Understanding Models
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
- 2025VideoMiner: Iteratively Grounding Key Frames of Hour-Long Videos via Tree-based Group Relative Policy Optimization
- 2025ReaSon: Reinforced Causal Search with Information Bottleneck for Video Understanding
- 2026Frame Differential On-Policy Self-Distillation for Video Reasoning
- 2025Tempo-R0: A Video-MLLM for Temporal Video Grounding through Efficient Temporal Sensing Reinforcement Learning