mlsanityData to 14 Oct 2026

Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding

arXiv 2603.19054 ↗First posted 19 Mar 2026cs.CV cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Recent advances in Streaming Video Understanding has enabled a new interaction paradigm where models respond proactively to user queries. Current proactive VideoLLMs rely on per-frame triggering decision making, which suffers from an efficiency-accuracy dilemma. We propose Em-Garde, a novel framework that decouples semantic understanding from streaming perception. At query time, the Instruction-Guided Proposal Parser transforms user queries into structured, perceptually grounded visual proposals; during streaming, a Lightweight Proposal Matching Module performs efficient embedding-based matching to trigger responses. Experiments on StreamingBench and OVO-Bench demonstrate consistent improvements over prior models in proactive response accuracy and efficiency, validating an effective solution for proactive video understanding under strict computational constraints.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 45 of its 56 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

45 of 56 references.

References · 45

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  9. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  10. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  11. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  12. 2024Long Context Transfer from Language to Visioncited by 515
33 more
  1. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 356
  2. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 318
  3. 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
  4. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
  5. 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 169
  6. 2024Streaming Long Video Understanding with Large Language Modelscited by 167
  7. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
  8. 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
  9. 2024Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputcited by 134
  10. 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 131
  11. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 127
  12. 2025Streaming Video Question-Answering with In-context Video KV-Cache Retrievalcited by 117
  13. 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 116
  14. 2024Video-CCAM: Enhancing Video-Language Understanding with Causal Cross-Attention Masks for Short and Long Videoscited by 98
  15. 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 97
  16. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
  17. 2025StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistantcited by 63
  18. 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
  19. 2024VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computationcited by 55
  20. 2025LiveVLM: Efficient Online Video Understanding via Streaming-Oriented KV Cache and Retrievalcited by 54
  21. 2024VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Formatcited by 47
  22. 2025StreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognitioncited by 46
  23. 2025ViSpeak: Visual Instruction Feedback in Streaming Videoscited by 42
  24. 2025Accelerating Streaming Video Large Language Models via Hierarchical Token Compressioncited by 37
  25. 2025StreamAgent: Towards Anticipatory Agents for Streaming Video Understandingcited by 33
  26. 2025RzenEmbed: Towards Comprehensive Multimodal Retrievalcited by 29
  27. 2025Eyes Wide Open: Ego Proactive Video-LLM for Streaming Videocited by 28
  28. 2025ProactiveVideoQA: A Comprehensive Benchmark Evaluating Proactive Interactions in Video Large Language Modelscited by 27
  29. 2025MMDuet2: Enhancing Proactive Interaction of Video MLLMs with Multi-Turn Reinforcement Learningcited by 22
  30. 2025AI for Service: Proactive Assistance with AI Glassescited by 20
  31. 2025Flashback: Memory-Driven Zero-shot, Real-time Video Anomaly Detectioncited by 12
  32. 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarioscited by 12
  33. 2025Less Redundancy: Boosting Practicality of Vision Language Model in Walking Assistantscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.