mlsanityData to 7 Oct 2026

StreamFlow: Dynamic Memory Flows for Streaming Video Understanding

arXiv 2608.10949 ↗First posted 11 Aug 2026cs.CV cs.CLcited by 0

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Streaming video understanding requires multimodal large language models (MLLMs) to preserve relevant evidence from continuously evolving streams under strict causality and bounded memory. Yet existing paradigms remain limited: model-based methods require intrusive backbone updates, while memory-based methods expend substantial visual-encoding computation on temporally redundant content and rely on rigid access to visual history. To address these limitations, we introduce StreamFlow, an efficient visual memory framework that enables dynamic, on-demand access to historical visual information. StreamFlow combines a lightweight, dynamics-aware mid-term memory that filters temporal redundancy before visual encoding with a latent long-term memory that consolidates historical video content into visual latents accessible to subsequent reasoning. During generation, an attention-guided retrieval mechanism injects relevant visual latents when the model's reliance on visual evidence weakens. StreamFlow achieves state-of-the-art streaming video understanding performance, reaching 67.73% overall accuracy on StreamingBench, while also delivering strong performance on offline long-video benchmarks. Relative to the vanilla setting, it improves the visual attention score (VAS) by 59.1% while reducing end-to-end latency and peak memory by 50.4% and 21.1%, respectively, enabling more visually grounded and efficient reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 50 of its 51 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

50 of 51 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Towards a Dynamic and Fixed-budget Memory Bank for Efficient Streaming Video Understanding24 Jun
  2. 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun
  3. 2026Scaling the Long Video Understanding of Multimodal Large Language Models via Visual Memory Mechanism31 Mar
  4. 2026HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understanding21 Jan
  5. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memory29 Sep
  6. 2025StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding21 Aug
  7. 2024Online Video Understanding: OVBench and VideoChat-Online31 Dec
  8. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding6 Nov
  9. 2024From Seconds to Hours: Reviewing MultiModal Large Language Models on Comprehensive Long Video Understanding27 Sep
  10. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May
  11. 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding8 Apr
  12. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmark28 Nov

Other references · 38

  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  3. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
  4. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  5. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  6. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
  7. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 316
  8. 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
  9. 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
  10. 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
  11. 2023Video Understanding with Large Language Models: A Surveycited by 203
  12. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
26 more
  1. 2024Streaming Long Video Understanding with Large Language Modelscited by 164
  2. 2026Qwen3.5-Omni Technical Reportcited by 146
  3. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
  4. 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 114
  5. 2025Streaming Video Question-Answering with In-context Video KV-Cache Retrievalcited by 112
  6. 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 90
  7. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
  8. 2024VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computationcited by 55
  9. 2025InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understandingcited by 54
  10. 2025LiveVLM: Efficient Online Video Understanding via Streaming-Oriented KV Cache and Retrievalcited by 50
  11. 2025StreamingTOM: Streaming Token Compression for Efficient Video Understandingcited by 41
  12. 2025VisMem: Latent Vision Memory Unlocks Potential of Vision-Language Modelscited by 31
  13. 2026A Simple Baseline for Streaming Video Understandingcited by 29
  14. 2025Cognitive Memory in Large Language Modelscited by 28
  15. 2026FluxMem: Adaptive Hierarchical Memory for Streaming Video Understandingcited by 26
  16. 2025StreamKV: Streaming Video Question-Answering with Segment-based KV Cache Retrieval and Compressioncited by 24
  17. 2024An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Modelscited by 22
  18. 2024VideoLLaMB: Long Streaming Video Understanding with Recurrent Memory Bridgescited by 20
  19. 2026Video Streaming Thinking: VideoLLMs Can Watch and Think Simultaneouslycited by 19
  20. 2026OASIS: On-Demand Hierarchical Event Memory for Streaming Video Reasoningcited by 16
  21. 2026Thinking in Streaming Videocited by 14
  22. 2026OneVision-Encoder: Codec-Aligned Sparsity as a Foundational Principle for Multimodal Intelligencecited by 10
  23. 2025Memory in Large Language Models: Mechanisms, Evaluation and Evolutioncited by 8
  24. 2026From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoningcited by 8
  25. 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMscited by 3
  26. 2026Spotlight and Shadow: Attention-Guided Dual-Anchor Introspective Decoding for MLLM Hallucination Mitigationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding
  2. 2026MEMO: Multi-Level Entity-Aware Memory for Streaming Video Understanding
  3. 2026Dynamic Hub-and-Spoke Memory for Streaming Video Understanding
  4. 2026StreamEMS: Streaming Video Understanding with Self-Evolving Memory Scheme for Vision-Language Models
  5. 2026What Should a Streaming Video Model Remember?
  6. 2026Semantic-Aware Adaptive Visual Memory for Streaming Video Understanding
  7. 2026CoRDS: Coreset-based Representative and Diverse Selection for Streaming Video Understanding
  8. 2026FlashBack: Knowing When to Remember in Streaming Vision-Language Models