mlsanityData to 7 Oct 2026

VQPy: An Object-Oriented Approach to Modern Video Analytics

arXiv 2311.01623 ↗First posted 3 Nov 2023cs.CV cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Video analytics is widely used in contemporary systems and services. At the forefront of video analytics are video queries that users develop to find objects of particular interest. Building upon the insight that video objects (e.g., human, animals, cars, etc.), the center of video analytics, are similar in spirit to objects modeled by traditional object-oriented languages, we propose to develop an object-oriented approach to video analytics. This approach, named VQPy, consists of a frontendunicodex2015a Python variant with constructs that make it easy for users to express video objects and their interactionsunicodex2015as well as an extensible backend that can automatically construct and optimize pipelines based on video objects. We have implemented and open-sourced VQPy, which has been productized in Cisco as part of its DeepVision framework.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 44 references that are in the map. First posted on arXiv 3 Nov 2023.

Builds on

18 of 44 references.

References · 18

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  3. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
  4. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
  5. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  6. 2015Visual Semantic Role Labelingcited by 188
  7. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  8. 2018Focus: Querying Large Video Datasets with Low Latency and Low Costcited by 46
  9. 2018BlazeIt: Optimizing Declarative Aggregation and Limit Queries for Neural Network-Based Video Analyticscited by 41
  10. 2021CityFlow-NL: Tracking and Retrieval of Vehicles at City Scale by Natural Language Descriptionscited by 26
  11. 2023The 7th AI City Challengecited by 20
  12. 2018Physical Representation-based Predicate Optimization for a Visual Analytics Databasecited by 19
6 more
  1. 2021Llama: A Heterogeneous & Serverless Framework for Auto-Tuning Video Analytics Pipelinescited by 16
  2. 2019Rekall: Specifying Video Events using Compositions of Spatiotemporal Labelscited by 14
  3. 2022Optimizing Machine Learning Inference Queries with Correlative Proxy Modelscited by 13
  4. 2022Serving and Optimizing Machine Learning Workflows on Heterogeneous Infrastructurescited by 12
  5. 2021Accelerating Approximate Aggregation Queries with Expensive Predicatescited by 9
  6. 2021THIA: Accelerating Video Analytics using Early Inference and Fine-Grained Query Planningcited by 8

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

  1. 2024Empower Vision Applications with LoRA LMMcited by 2