mlsanityData to 7 Oct 2026

STRIDE: When to Speak Meets Sequence Denoising for Streaming Video Understanding

arXiv 2603.27593 ↗First posted 29 Mar 2026cs.CV cs.AIcited by 2

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Recent progress in video large language models (Video-LLMs) has enabled strong offline reasoning over long and complex videos. However, real-world deployments increasingly require streaming perception and proactive interaction, where video frames arrive online and the system must decide not only what to respond, but also when to respond. In this work, we revisit proactive activation in streaming video as a structured sequence modeling problem, motivated by the observation that temporal transitions in streaming video naturally form span-structured activation patterns. To capture this span-level structure, we model activation signals jointly over a sliding temporal window and update them iteratively as new frames arrive. We propose STRIDE (Structured Temporal Refinement with Iterative DEnoising), which employs a lightweight masked diffusion module at the activation interface to jointly predict and progressively refine activation signals across the window. Extensive experiments on diverse streaming benchmarks and downstream models demonstrate that STRIDE shows more reliable and temporally coherent proactive responses, significantly improving when-to-speak decision quality in online streaming scenarios.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 76 of its 82 references that are in the map. First posted on arXiv 29 Mar 2026.

Builds on

76 of 82 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  2. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding22 May
  3. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov

Other references · 73

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  10. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  12. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
38 more
  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  4. 2025Gemma 3 Technical Reportcited by 1,686
  5. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  6. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  7. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  8. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  9. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  10. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  11. 2025Large Language Diffusion Modelscited by 872
  12. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  13. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  14. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
  15. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  16. 2017Localizing Moments in Video with Natural Languagecited by 660
  17. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
  18. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
  19. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
  20. 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
  21. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  22. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  23. 2025Dream 7B: Diffusion Large Language Modelscited by 515
  24. 2024Long Context Transfer from Language to Visioncited by 502
  25. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
  26. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
  27. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  28. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
  29. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
  30. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
  31. 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
  32. 2024Streaming Long Video Understanding with Large Language Modelscited by 164
  33. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
  34. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
  35. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 135
  36. 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 134
  37. 2024Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputcited by 132
  38. 2018Charades-Ego: A Large-Scale Dataset of Paired Third and First Person Videoscited by 127

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026StreamPro: From Reactive Perception to Proactive Decision-Making in Streaming Video
  2. 2026LiveStarPro: Proactive Streaming Video Understanding with Hierarchical Memory for Long-Horizon Streams
  3. 2025LiveStar: Live Streaming Assistant for Real-World Online Video Understanding
  4. 2026OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interaction
  5. 2026Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs
  6. 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
  7. 2026Think While Watching: Online Streaming Segment-Level Memory for Multi-Turn Video Reasoning in Multimodal Large Language Models
  8. 2026StreamReady: Learning What to Answer and When in Long Streaming Videos