VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding
Not on the map. Why?
Abstract (arXiv)
We introduce VideoKR, the first large-scale training corpus specifically designed to strengthen knowledge- and reasoning-intensive video understanding. It comprises 315K video reasoning examples over 145K newly collected, CC-licensed, expert-domain videos. We develop a human-in-the-loop, skill-oriented example generation pipeline that targets progressively deeper video reasoning capabilities while ensuring the difficulty, diversity, and reliability of both the examples and their CoT rationales. We also curate VideoKR-Eval, a new expert-annotated benchmark where questions require genuine video understanding and knowledge-intensive reasoning rather than textual shortcuts. Our experiments show that, under a standard SFTrightarrowGRPO pipeline, models post-trained on VideoKR outperform prior post-training approaches on knowledge-intensive video reasoning while remaining competitive on general video reasoning, highlighting data design as a key driver of progress in video reasoning. We further conduct comprehensive ablations to isolate the contributions of VideoKR, providing actionable insights for future work.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 42 of its 50 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
42 of 50 references.
References · 42
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
30 more
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 292
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
- 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 213
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
- 2024Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Expertscited by 108
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 93
- 2024Apollo: An Exploration of Video Understanding in Large Multimodal Modelscited by 89
- 2025Scaling RL to Long Videoscited by 84
- 2024VideoVista: A Versatile Benchmark for Video Understanding and Reasoningcited by 72
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selectioncited by 65
- 2023Grounded Question-Answering in Long Egocentric Videoscited by 64
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2024VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videoscited by 51
- 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 49
- 2025Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videoscited by 44
- 2025Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmarkcited by 37
- 2025Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformerscited by 36
- 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learningcited by 34
- 2024Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervisioncited by 25
- 2026VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twicecited by 21
- 2025VideoReasonBench: Can MLLMs Perform Vision-Centric Complex Video Reasoning?cited by 20
- 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 19
- 2025Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thoughtcited by 14
- 2025LongViTU: Instruction Tuning for Long-Form Video Understandingcited by 13
- 2024VELOCITI: Benchmarking Video-Language Compositional Reasoning with Strict Entailmentcited by 10
- 2025Video Spatial Reasoning with Object-Centric 3D Rolloutcited by 6
- 2025Video-R4: Reinforcing Text-Rich Video Reasoning with Visual Ruminationcited by 6
- 2025VideoPerceiver: Enhancing Fine-Grained Temporal Perception in Video Multimodal Large Language Modelscited by 5
- 2023Vision Enhancing LLMs: Empowering Multimodal Knowledge Storage and Sharing in LLMscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026A Very Big Video Reasoning Suite
- 2025Video-Skill-CoT: Skill-based Chain-of-Thoughts for Domain-Adaptive Video Reasoning
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcing
- 2026UpstreamQA: A Modular Framework for Explicit Reasoning on Video Question Answering Tasks
- 2026A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding
- 2025CoTasks: Chain-of-Thought based Video Instruction Tuning Tasks
- 2025Rethinking Chain-of-Thought Reasoning for Videos
- 2026Clue Matters: Leveraging Latent Visual Clues to Empower Video Reasoning