AQuA: Analytical Quality Assessment for Optimizing Video Analytics Systems
Not on the map. Why?
Abstract (arXiv)
Millions of cameras at edge are being deployed to power a variety of different deep learning applications. However, the frames captured by these cameras are not always pristine - they can be distorted due to lighting issues, sensor noise, compression etc. Such distortions not only deteriorate visual quality, they impact the accuracy of deep learning applications that process such video streams. In this work, we introduce AQuA, to protect application accuracy against such distorted frames by scoring the level of distortion in the frames. It takes into account the analytical quality of frames, not the visual quality, by learning a novel metric, classifier opinion score, and uses a lightweight, CNN-based, object-independent feature extractor. AQuA accurately scores distortion levels of frames and generalizes to multiple different deep learning applications. When used for filtering poor quality frames at edge, it reduces high-confidence errors for analytics applications by 17%. Through filtering, and due to its low overhead (14ms), AQuA can also reduce computation time and average bandwidth usage by 25%.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 85 references that are in the map. First posted on arXiv 24 Jan 2021.
Builds on
29 of 85 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Mask R-CNNcited by 7,259
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2014Going Deeper with Convolutionscited by 4,231
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
17 more
- 2019Searching for MobileNetV3cited by 1,984
- 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 542
- 2017NIMA: Neural Image Assessmentcited by 387
- 2015Recent Advances in Convolutional Neural Networkscited by 360
- 2020DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolutioncited by 222
- 2016Improving the Robustness of Deep Neural Networks via Stability Trainingcited by 156
- 2016Understanding How Image Quality Affects Deep Neural Networkscited by 118
- 2016Examining the Impact of Blur on Recognition by Convolutional Networkscited by 58
- 2018Task-Driven Super Resolution: Object Detection in Low-resolution Imagescited by 52
- 2018Effects of Degradations on Deep Neural Network Architecturescited by 47
- 2018PoseFix: Model-agnostic General Human Pose Refinement Networkcited by 47
- 2019Scaling Video Analytics on Constrained Edge Nodescited by 36
- 2017On Classification of Distorted Images with Deep Convolutional Neural Networkscited by 26
- 2018Face Recognition in Low Quality Images: A Surveycited by 18
- 2018A Fast and Accurate System for Face Detection, Identification, and Verificationcited by 10
- 2018Effects of Image Degradations to CNN-based Image Classificationcited by 6
- 2020AI on the Edge: Rethinking AI-based IoT Applications Using Specialized Edge Architecturescited by 3
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 1.
6 papers.
- 2022Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniquescited by 7
- 2023MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurationscited by 7
- 2021Enhancing Video Analytics Accuracy via Real-time Automated Camera Parameter Tuningcited by 4
- 2021VMAF And Variants: Towards A Unified VQAcited by 2
- 2021A Survey of Performance Optimization in Neural Network-Based Video Analytics Systemscited by 0
- 2022APT: Adaptive Perceptual quality based camera Tuning using reinforcement learningcited by 0
- 2023MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations4 Apr 2023
- 2022Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniques28 Nov 2022
- 2022APT: Adaptive Perceptual quality based camera Tuning using reinforcement learning15 Nov 2022
- 2021Enhancing Video Analytics Accuracy via Real-time Automated Camera Parameter Tuning8 Jul 2021
- 2021A Survey of Performance Optimization in Neural Network-Based Video Analytics Systems10 May 2021
- 2021VMAF And Variants: Towards A Unified VQA13 Mar 2021