BLUE: Semantics-Preserving Video Compression for Efficient Vision-Language Surveillance Analytics
Not on the map. Why?
Abstract (arXiv)
Continuous surveillance video creates a growing storage, transmission, and inference burden for enterprise video analytics systems. While modern codecs such as H.265 reduce bitrate for human-viewable video, aggressive compression can degrade downstream computer-vision performance and does not necessarily reduce the number of vision-language model (VLM) inference calls required for semantic video understanding. This paper evaluates BLUE, a fixed-camera surveillance compression approach that suppresses static-background redundancy while preserving foreground activity, for its effect on VLM-based event and anomaly understanding. We compare raw H.265 and BLUE-compressed H.265 video on two surveillance datasets: VIRAT, comprising 227 paired event samples from 106 clips, and CHAD, comprising 54 human-activity anomaly clips. For each pair, the same frame index is evaluated using a VLM captioning pipeline, and outputs are scored against annotation-derived ground truth using a blind judging protocol. The results show no measurable degradation in semantic inference quality. On VIRAT, the mean VLM score remains effectively unchanged between raw H.265 and BLUE, with a mean difference of approximately -0.01 on a 0-10 scale. On CHAD, raw H.265 and BLUE obtain near-equivalent mean scores of 4.31 and 4.26, respectively. Compression saving is also uncorrelated with VLM score change on VIRAT (r = 0.004), indicating that higher BLUE compression does not predict semantic quality loss. Beyond storage reduction, BLUE increases the share of skip-heavy P-frames on CHAD from 1.4% to 53.2%, enabling an estimated 53% reduction in VLM calls through packet-size-based frame skipping. These findings suggest that BLUE functions as a machine-centric compression layer for surveillance video, reducing bandwidth and inference cost while preserving VLM semantic performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
15 of 22 references.
References · 15
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2022How Do Vision Transformers Work?cited by 307
- 2016Understanding How Image Quality Affects Deep Neural Networkscited by 119
- 2019Image and Video Compression with Neural Networks: A Reviewcited by 86
- 2020Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analyticscited by 80
- 2020A Technical Overview of AV1cited by 47
- 2022CHAD: Charlotte Anomaly Datasetcited by 18
- 2021Advances In Video Compression System Using Deep Neural Network: A Review And Case Studiescited by 14
- 2021Recent Standard Development Activities on Video Coding for Machinescited by 14
- 2020On the Impact of Lossy Image and Video Compression on the Performance of Deep Convolutional Neural Network Architecturescited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SurveillanceVQA-589K: A Benchmark for Comprehensive Surveillance Video-Language Understanding with Large Models
- 2025VideoScan: Enabling Efficient Streaming Video Understanding via Frame-level Semantic Carriers
- 2025Benchmarking and Enhancing VLM for Compressed Image Understanding
- 2026Prune Redundancy, Preserve Essence: Vision Token Compression in VLMs via Synergistic Importance-Diversity
- 2025Seeing More, Saying More: Lightweight Language Experts are Dynamic Video Token Compressors
- 2026CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM Inference
- 2025LVC: A Lightweight Compression Framework for Enhancing VLMs in Long Video Understanding
- 2025METok: Multi-Stage Event-based Token Compression for Efficient Long Video Understanding