mlsanityData to 7 Oct 2026

StreamOPD: A Post-Training Recipe with Spatio-Temporal Cue Gating for Streaming Video Understanding

arXiv 2608.16320 ↗First posted 17 Aug 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Streaming video understanding demands direct responses from the causally observed prefix of an unfolding video. Existing systems add inference-time memory, retrieval, and compression, yet a training-free sliding-window baseline already matches them. We therefore fix a memory-free recent-window protocol and ask how far post-training alone can go. Reinforcement learning with verifiable rewards fits this regime poorly, encouraging long ``think-then-answer'' generations, while on-policy distillation (OPD) supplies dense token-level teacher supervision on student trajectories but is stable only when both models train in thinking mode. These observations lead to textscStreamOPD, a recipe combining verifiable streaming-video data, thinking-mode OPD, and instruct-mode deployment. It raises StreamingBench from 77.9% to 83.9%---within 0.3 points of the 9B teacher---and improves OVO-Bench excluding its hallucination-detection subtask (HLD) by 9.1 points under unchanged inference. As a teacher-privilege extension, Spatio-Temporal CueGate (ST-CueGate) aggregates cue-versus-no-cue teacher likelihood ratios into a group-relative response score that reweights OPD. It reaches 71.9% on OVO-Bench (excluding HLD) and 64.9% on Video-MME, and is the only variant that stays above the base model on all four benchmarks. Replacing the teacher with a frozen copy of the student's initial policy---on-policy self-distillation---retains most of these gains and lifts HLD to 57.0%, above both the untrained student and the 9B teacher, so abstention loss is not intrinsic to the recipe. We provide a transparent and reproducible reference for open-source streaming-video research.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

30 of 45 references.

References · 30

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  7. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  8. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  9. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  10. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  11. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
  12. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
18 more
  1. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  2. 2015Unifying distillation and privileged informationcited by 218
  3. 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
  4. 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
  5. 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 134
  6. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
  7. 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 90
  8. 2025Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understandingcited by 80
  9. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 71
  10. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
  11. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
  12. 2026HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understandingcited by 36
  13. 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillationcited by 32
  14. 2026A Simple Baseline for Streaming Video Understandingcited by 29
  15. 2026ViCuR: Visual Cues as Recoverable Privilege for Multimodal On-Policy Distillationcited by 12
  16. 2026V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoningcited by 10
  17. 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RLcited by 8
  18. 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thinking in Streaming Video
  2. 2026StreamPro: From Reactive Perception to Proactive Decision-Making in Streaming Video
  3. 2026Think While Watching: Online Streaming Segment-Level Memory for Multi-Turn Video Reasoning in Multimodal Large Language Models
  4. 2026Video Streaming Thinking: VideoLLMs Can Watch and Think Simultaneously
  5. 2026Video-OPSD: Exploiting Privileged Visual Evidence for On-Policy Self-Distillation in Video Large Language Models
  6. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
  7. 2026Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding
  8. 2026StreamReady: Learning What to Answer and When in Long Streaming Videos