mlsanityData to 14 Oct 2026

Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge

arXiv 2501.13468 ↗First posted 23 Jan 2025cs.CV cs.AIcited by 73

Not on the map. Why?

Cited by 23 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advances in Large Language Models (LLMs) have enabled the development of Video-LLMs, advancing multimodal learning by bridging video data with language tasks. However, current video understanding models struggle with processing long video sequences, supporting multi-turn dialogues, and adapting to real-world dynamic scenarios. To address these issues, we propose StreamChat, a training-free framework for streaming video reasoning and conversational interaction. StreamChat leverages a novel hierarchical memory system to efficiently process and compress video features over extended sequences, enabling real-time, multi-turn dialogue. Our framework incorporates a parallel system scheduling strategy that enhances processing speed and reduces latency, ensuring robust performance in real-world applications. Furthermore, we introduce StreamBench, a versatile benchmark that evaluates streaming video understanding across diverse media types and interactive scenarios, including multi-turn interactions and complex reasoning tasks. Extensive evaluations on StreamBench and other public benchmarks demonstrate that StreamChat significantly outperforms existing state-of-the-art models in terms of accuracy and response times, confirming its effectiveness for streaming video understanding. Code is available at StreamChat: https://github.com/hmxiong/StreamChat.

Key facts. Cited by 73 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Jan 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 23; 2026: 50.

73 papers.

Sort:

By area:

  1. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
  2. 2025StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistantcited by 63
  3. 2025StreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognitioncited by 46
  4. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
  5. 2025StreamingTOM: Streaming Token Compression for Efficient Video Understandingcited by 43
  6. 2025ViSpeak: Visual Instruction Feedback in Streaming Videoscited by 42
  7. 2026HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understandingcited by 41
  8. 2025StreamAgent: Towards Anticipatory Agents for Streaming Video Understandingcited by 33
  9. 2026A Simple Baseline for Streaming Video Understandingcited by 33
  10. 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
  11. 2026FluxMem: Adaptive Hierarchical Memory for Streaming Video Understandingcited by 28
  12. 2025Streaming Video Instruction Tuningcited by 26
38 more
  1. 2025LiveStar: Live Streaming Assistant for Real-World Online Video Understandingcited by 25
  2. 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thoughtcited by 24
  3. 2025RTV-Bench: Benchmarking MLLM Continuous Perception, Understanding and Reasoning through Real-Time Videocited by 21
  4. 2026StreamReady: Learning What to Answer and When in Long Streaming Videoscited by 19
  5. 2026OASIS: On-Demand Hierarchical Event Memory for Streaming Video Reasoningcited by 19
  6. 2025AdsQA: Towards Advertisement Video Understandingcited by 13
  7. 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agentscited by 12
  8. 2025OwlCap: Harmonizing Motion-Detail for Video Captioning via HMD-270K and Caption Set Equivalence Rewardcited by 12
  9. 2025LiveCC: Learning Video LLM with Streaming Speech Transcription at Scalecited by 9
  10. 2026StreamMeCo: Long-Term Agent Memory Compression for Efficient Streaming Video Understandingcited by 9
  11. 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
  12. 2025StreamGaze: Gaze-Guided Temporal Reasoning and Proactive Understanding in Streaming Videoscited by 8
  13. 2026Speak While Watching: Unleashing TRUE Real-Time Video Understanding Capability of Multimodal Large Language Modelscited by 8
  14. 2026Position: Modular Memory is the Key to Continual Learning Agentscited by 8
  15. 2026IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous Streamscited by 7
  16. 2026What Should a Streaming Video Model Remember?cited by 7
  17. 2026ROMA: Real-time Omni-Multimodal Assistant with Interactive Streaming Understandingcited by 6
  18. 2026Event-VStream: Event-Driven Real-Time Understanding for Long Video Streamscited by 6
  19. 2026Think-as-You-See: Streaming Chain-of-Thought Reasoning for Large Vision-Language Modelscited by 6
  20. 2026EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understandingcited by 6
  21. 2025CogStream: Context-guided Streaming Video Question Answeringcited by 5
  22. 2025Building Egocentric Procedural AI Assistant: Methods, Benchmarks, and Challengescited by 5
  23. 2025V-Rex: Real-Time Streaming Video LLM Acceleration via Dynamic KV Cache Retrievalcited by 5
  24. 2026CurveStream: Boosting Streaming Video Understanding in MLLMs via Curvature-Aware Hierarchical Visual Memory Managementcited by 5
  25. 2026Progressive Online Video Understanding with Evidence-Aligned Timing and Transparent Decisionscited by 5
  26. 2026StreamOV: Streaming Omni-Video Understanding via Evidence-Guided Memory and Response Triggeringcited by 5
  27. 2026EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Visioncited by 5
  28. 2026StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMscited by 5
  29. 2025Video-QTR: Query-Driven Temporal Reasoning Framework for Lightweight Video Understandingcited by 4
  30. 2026StreamingClaw Technical Reportcited by 4
  31. 2026STRIDE: When to Speak Meets Sequence Denoising for Streaming Video Understandingcited by 4
  32. 2026Don't Pause! Every prediction matters in a streaming videocited by 4
  33. 2026Harnessing Streaming Video in the Wildcited by 4
  34. 2026FOLIO: Focused Semantic Memory for Streaming Video Understandingcited by 4
  35. 2026Towards Spatial Supersensing in the Wildcited by 4
  36. 2026StreamScout: Learning When to Look Deeper for Streaming Video Understandingcited by 3
  37. 2025Chat with AI: The Surprising Turn of Real-time Video Communication from Human to AIcited by 2
  38. 2026FreshMem: Brain-Inspired Frequency-Space Hybrid Memory for Streaming Video Understandingcited by 2

50 most cited of 73 All 73 (JSON)