mlsanityData to 7 Oct 2026

CoVStream: Edge-Cloud Collaboration for Understanding of Long Video Streams

arXiv 2606.22804 ↗First posted 22 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Long, continuous video streams are an increasingly critical driver of multimedia intelligence. Existing efforts often handle long videos with a sample-encode-reason approach using large models. However, they overlook a crucial deployment fact: the stream is often produced by computationally constrained devices. This forces an untenable compromise: cloud offloading unlocks strong reasoning but incurs prohibitive bandwidth overhead, while on-device processing remains limited by edge hardware capacity. Therefore, we propose CoVStream, the first edge-cloud collaborative framework for understanding long video streams. The edge node distills raw video streams into compact visual features and semantic captions for transmission to the cloud, minimizing bandwidth costs, while the cloud server integrates this data into an entity graph and global visual context, activating the heavy reasoning model only when a user query arrives. Experiments on VideoMME-Long, LVBench, and RTV-Bench show that CoVStream reduces bandwidth usage by 87.6% while retaining 99.2% of the cloud baseline accuracy on LVBench.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

37 of 58 references.

References · 37

  1. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  2. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  3. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
  4. 2024Long Context Transfer from Language to Visioncited by 502
  5. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
  6. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
  7. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  8. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
  9. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  10. 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 223
  11. 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
  12. 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
25 more
  1. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  2. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
  3. 2024HourVideo: 1-Hour Video-Language Understandingcited by 110
  4. 2024Video-CCAM: Enhancing Video-Language Understanding with Causal Cross-Attention Masks for Short and Long Videoscited by 95
  5. 2025Flash-VStream: Efficient Real-Time Understanding for Long Video Streamscited by 78
  6. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 71
  7. 2023Large Language Models Empowered Autonomous Edge AI for Connected Intelligencecited by 55
  8. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  9. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  10. 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoTcited by 36
  11. 2022Where is my Wallet? Modeling Object Proposal Sets for Egocentric Visual Query Localizationcited by 24
  12. 2024PerLLM: Personalized Inference Scheduling with Edge-Cloud Collaboration for Diverse LLM Servicescited by 23
  13. 2025Building a Mind Palace: Structuring Environment-Grounded Semantic Graphs for Effective Long Video Analysis with LLMscited by 19
  14. 2022Cloud-Device Collaborative Adaptation to Continual Changing Environments in the Real-worldcited by 16
  15. 2024Adaptive Video Understanding Agent: Enhancing efficiency with dynamic frame sampling and feedback-driven reasoningcited by 16
  16. 2023PrivateLoRA For Efficient Privacy Preserving LLMcited by 14
  17. 2024SEAL: Semantic Attention Learning for Long Video Representationcited by 12
  18. 2025Fine-grained Spatiotemporal Grounding on Egocentric Videoscited by 11
  19. 2025SpecEdge: Scalable Edge-Assisted Serving Framework for Interactive LLMscited by 10
  20. 2024Hallucination Mitigation Prompts Long-term Video Understandingcited by 7
  21. 2025Token Level Routing Inference System for Edge Devicescited by 4
  22. 2026AIVD: Adaptive Edge-Cloud Collaboration for Accurate and Efficient Industrial Visual Detectioncited by 4
  23. 2024LAECIPS: Large Vision Model Assisted Adaptive Edge-Cloud Collaboration for IoT-based Embodied Intelligence Systemcited by 2
  24. 2025Reliable LLM-Based Edge-Cloud-Expert Cascades for Telecom Knowledge Systemscited by 2
  25. 2026MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarioscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Venus: An Efficient Edge Memory-and-Retrieval System for VLM-based Online Video Understanding
  2. 2026DAT: Dual-Aware Adaptive Transmission for Efficient Multimodal LLM Inference in Edge-Cloud Systems
  3. 2026LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference
  4. 2026Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Models
  5. 2026CurveStream: Boosting Streaming Video Understanding in MLLMs via Curvature-Aware Hierarchical Visual Memory Management
  6. 2026X-Stream: Exploring MLLMs as Multiplexers for Multi-Stream Understanding
  7. 2026HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understanding
  8. 2024Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Models