STRIDE: When to Speak Meets Sequence Denoising for Streaming Video Understanding
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent progress in video large language models (Video-LLMs) has enabled strong offline reasoning over long and complex videos. However, real-world deployments increasingly require streaming perception and proactive interaction, where video frames arrive online and the system must decide not only what to respond, but also when to respond. In this work, we revisit proactive activation in streaming video as a structured sequence modeling problem, motivated by the observation that temporal transitions in streaming video naturally form span-structured activation patterns. To capture this span-level structure, we model activation signals jointly over a sliding temporal window and update them iteratively as new frames arrive. We propose STRIDE (Structured Temporal Refinement with Iterative DEnoising), which employs a lightweight masked diffusion module at the activation interface to jointly predict and progressively refine activation signals across the window. Extensive experiments on diverse streaming benchmarks and downstream models demonstrate that STRIDE shows more reliable and temporally coherent proactive responses, significantly improving when-to-speak decision quality in online streaming scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 76 of its 82 references that are in the map. First posted on arXiv 29 Mar 2026.
Builds on
76 of 82 references.
Closest ancestors · 3
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding22 May
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
Other references · 73
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
38 more
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025Gemma 3 Technical Reportcited by 1,686
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2025Large Language Diffusion Modelscited by 872
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
- 2023VILA: On Pre-training for Visual Language Modelscited by 686
- 2017Localizing Moments in Video with Natural Languagecited by 660
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
- 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
- 2025Dream 7B: Diffusion Large Language Modelscited by 515
- 2024Long Context Transfer from Language to Visioncited by 502
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
- 2024Streaming Long Video Understanding with Large Language Modelscited by 164
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 135
- 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 134
- 2024Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputcited by 132
- 2018Charades-Ego: A Large-Scale Dataset of Paired Third and First Person Videoscited by 127
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026StreamPro: From Reactive Perception to Proactive Decision-Making in Streaming Video
- 2026LiveStarPro: Proactive Streaming Video Understanding with Hierarchical Memory for Long-Horizon Streams
- 2025LiveStar: Live Streaming Assistant for Real-World Online Video Understanding
- 2026OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interaction
- 2026Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs
- 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
- 2026Think While Watching: Online Streaming Segment-Level Memory for Multi-Turn Video Reasoning in Multimodal Large Language Models
- 2026StreamReady: Learning What to Answer and When in Long Streaming Videos