# VID-WIN: Fast Video Event Matching with Query-Aware Windowing at the Edge for the Internet of Multimedia Things

arXiv: https://arxiv.org/abs/2105.02957 · HTML: https://mlsanity.com/paper/2105.02957/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 18 of its 95 references that are in the map.
- First posted on arXiv 27 Apr 2021.

## Builds on (most cited first, 18 of 18)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://mlsanity.com/paper/1506.01497/) (2015)
- [You Only Look Once: Unified, Real-Time Object Detection](https://mlsanity.com/paper/1506.02640/) (2015)
- [MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications](https://mlsanity.com/paper/1704.04861/) (2017)
- [Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition](https://mlsanity.com/paper/1406.4729/) (2014)
- [Focus: Querying Large Video Datasets with Low Latency and Low Cost](https://mlsanity.com/paper/1801.03493/) (2018)
- [BlazeIt: Optimizing Declarative Aggregation and Limit Queries for Neural Network-Based Video Analytics](https://mlsanity.com/paper/1805.01046/) (2018)
- [Scaling Video Analytics on Constrained Edge Nodes](https://mlsanity.com/paper/1905.13536/) (2019)
- [Physical Representation-based Predicate Optimization for a Visual Analytics Database](https://mlsanity.com/paper/1806.04226/) (2018)
- [iFogSim: A Toolkit for Modeling and Simulation of Resource Management Techniques in Internet of Things, Edge and Fog Computing Environments](https://mlsanity.com/paper/1606.02007/) (2016)
- [VidCEP: Complex Event Processing Framework to Detect Spatiotemporal Patterns in Video Streams](https://mlsanity.com/paper/2007.07817/) (2020)
- [Precision and Recall for Range-Based Anomaly Detection](https://mlsanity.com/paper/1801.03175/) (2018)
- [eSPICE: Probabilistic Load Shedding from Input Event Streams in Complex Event Processing](https://mlsanity.com/paper/2002.05896/) (2020)
- [pSPICE: Partial Match Shedding for Complex Event Processing](https://mlsanity.com/paper/2002.04436/) (2020)
- [hSPICE: State-Aware Event Shedding in Complex Event Processing](https://mlsanity.com/paper/2006.08211/) (2020)
- [Foundations of Complex Event Processing](https://mlsanity.com/paper/1709.05369/) (2017)
- [Knowledge Graph Driven Approach to Represent Video Streams for Spatiotemporal Event Pattern Matching in Complex Event Processing](https://mlsanity.com/paper/2007.06292/) (2020)
- [Traffic Prediction Framework for OpenStreetMap using Deep Learning based Complex Event Processing and Open Traffic Cameras](https://mlsanity.com/paper/2008.00928/) (2020)

## Abstract (arXiv)

Efficient video processing is a critical component in many IoMT applications to detect events of interest. Presently, many window optimization techniques have been proposed in event processing with an underlying assumption that the incoming stream has a structured data model. Videos are highly complex due to the lack of any underlying structured data model. Video stream sources such as CCTV cameras and smartphones are resource-constrained edge nodes. At the same time, video content extraction is expensive and requires computationally intensive Deep Neural Network (DNN) models that are primarily deployed at high-end (or cloud) nodes. This paper presents VID-WIN, an adaptive 2-stage allied windowing approach to accelerate video event analytics in an edge-cloud paradigm. VID-WIN runs parallelly across edge and cloud nodes and performs the query and resource-aware optimization for state-based complex event matching. VID-WIN exploits the video content and DNN input knobs to accelerate the video inference process across nodes. The paper proposes a novel content-driven micro-batch resizing, queryaware caching and micro-batch based utility filtering strategy of video frames under resource-constrained edge nodes to improve the overall system throughput, latency, and network usage. Extensive evaluations are performed over five real-world datasets. The experimental results show that VID-WIN video event matching achieves ~2.3X higher throughput with minimal latency and ~99% bandwidth reduction compared to other baselines while maintaining query-level accuracy and resource bounds.