mlsanityData to 14 Oct 2026

VideoCuRL: Video Curriculum Reinforcement Learning with Orthogonal Difficulty Decomposition

arXiv 2601.00887 ↗First posted 31 Dec 2025cs.CVcited by 3

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Reinforcement Learning (RL) is crucial for empowering VideoLLMs with complex spatiotemporal reasoning. However, current RL paradigms predominantly rely on random data shuffling or naive curriculum strategies based on scalar difficulty metrics. We argue that scalar metrics fail to disentangle two orthogonal challenges in video understanding: Visual Temporal Perception Load and Cognitive Reasoning Depth. To address this, we propose VideoCuRL, a novel framework that decomposes difficulty into these two axes. We employ efficient, training-free proxies, optical flow and keyframe entropy for visual complexity, Calibrated Surprisal for cognitive complexity, to map data onto a 2D curriculum grid. A competence aware Diagonal Wavefront strategy then schedules training from base alignment to complex reasoning. Furthermore, we introduce Dynamic Sparse KL and Structured Revisiting to stabilize training against reward collapse and catastrophic forgetting. Extensive experiments show that VideoCuRL surpasses strong RL baselines on reasoning (+2.5 on VSI-Bench) and perception (+2.9 on VideoMME) tasks. Notably, VideoCuRL eliminates the prohibitive inference overhead of generation-based curricula, offering a scalable solution for robust video post-training.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 36 references that are in the map. First posted on arXiv 31 Dec 2025.

Builds on

28 of 36 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  2. 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
  3. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  4. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  5. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar

Other references · 23

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  6. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  7. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  8. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  9. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  10. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  11. 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
  12. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
11 more
  1. 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
  2. 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
  3. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
  4. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 322
  5. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  6. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
  7. 2024Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputcited by 134
  8. 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
  9. 2023BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuningcited by 41
  10. 2024PPLLaVA: Varied Video Sequence Understanding With Prompt Guidancecited by 20
  11. 2025AdaCuRL: Adaptive Curriculum Reinforcement Learning with Invalid Sample Mitigation and Historical Revisitingcited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  2. 2026Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding
  3. 2026Video Models Can Reason with Verifiable Rewards
  4. 2025VideoTG-R1: Boosting Video Temporal Grounding via Curriculum Reinforcement Learning on Reflected Boundary Annotations
  5. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
  6. 2026Think with Grounding: Curriculum Reinforced Reasoning with Video Grounding for Long Video Understanding
  7. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
  8. 2026Find, Fix, Reason: Context Repair for Video Reasoning