mlsanityData to 14 Oct 2026

Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding

arXiv 2609.40055 ↗First posted 30 Sep 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

also in 1 more
Abstract (arXiv)

On-policy distillation (OPD) provides dense supervision directly on student-generated trajectories, making it an effective post-training strategy for vision-language models in temporal video grounding (TVG). However, existing pipelines typically construct the training curriculum from a fixed teacher and the initial student state, implicitly assuming that selected examples retain positive supervision value throughout optimization. We show that supervision trustworthiness and supervision necessity are distinct yet coupled: the former concerns target credibility, while the latter varies with the student's current task competence; together, they shape supervision value. Building on this coupled view, we introduce Student-Curriculum Coupling (SCC), a closed-loop framework in which a compact Anchor-Frontier curriculum defines the candidate supervision space and the evolving student dynamically determines its active subset. Supervision can therefore be activated, suspended, or reactivated as competence changes, concentrating teacher computation and optimization on current task-level deficits. Across three TVG benchmarks, SCC achieves a 5.1% relative improvement in mean recall over Video-OPD on its original curriculum, while using 60.0% fewer training examples and reducing training time by 50.4%. Ablations support the complementary roles of capability-structured curriculum design and student-dependent supervision in achieving these gains. Together, these results establish SCC as a data- and compute-efficient framework for TVG post-training, delivering stronger temporal grounding by aligning trustworthy supervision with the student's evolving learning needs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 44 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

40 of 44 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation3 Feb
  2. 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec
  3. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Grounding17 Mar
  4. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling31 Dec
  5. 2024ReVisionLLM: Recursive Vision-Language Model for Temporal Grounding in Hour-Long Videos22 Nov
  6. 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning25 Oct
  7. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May
  8. 2024LITA: Language Instructed Temporal-Localization Assistant27 Mar
  9. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding4 Dec
  10. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmark28 Nov

Other references · 30

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2025OpenAI GPT-5 System Cardcited by 989
  6. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  7. 2017Localizing Moments in Video with Natural Languagecited by 663
  8. 2017TALL: Temporal Activity Localization via Language Querycited by 584
  9. 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 579
  10. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  11. 2015Policy Distillationcited by 440
  12. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
18 more
  1. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
  2. 2026Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipecited by 299
  3. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
  4. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
  5. 2024RegMix: Data Mixture as Regression for Language Model Pre-trainingcited by 177
  6. 2026Entropy-Aware On-Policy Distillation of Language Modelscited by 175
  7. 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 121
  8. 2025MiMo-VL Technical Reportcited by 115
  9. 2019Accelerating Deep Learning by Focusing on the Biggest Loserscited by 94
  10. 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 91
  11. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 89
  12. 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 86
  13. 2023Hierarchical Video-Moment Retrieval and Step-Captioningcited by 83
  14. 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
  15. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
  16. 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 19
  17. 2024COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Trainingcited by 18
  18. 2025iMOVE: Instance-Motion-Aware Video Understandingcited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Redirecting Teacher Supervision: Temporal-Response-Guided Latent Distillation for Video-Language Models
  2. 2026From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models
  3. 2026Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding
  4. 2025VideoTG-R1: Boosting Video Temporal Grounding via Curriculum Reinforcement Learning on Reflected Boundary Annotations
  5. 2026Counterfactual Attention Policy Distillation for Temporal Video Grounding
  6. 2026CA-OPD: Confidence-Aware On-Policy Distillation for Structured Visual Prediction
  7. 2026Do As I Do, Not As I Say: On-Policy Distillation Inherits the Teacher in Vision-Language Models
  8. 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation