Secure Video Quality Assessment Resisting Adversarial Attacks
Not on the map. Why?
Abstract (arXiv)
The exponential surge in video traffic has intensified the imperative for Video Quality Assessment (VQA). Leveraging cutting-edge architectures, current VQA models have achieved human-comparable accuracy. However, recent studies have revealed the vulnerability of existing VQA models against adversarial attacks. To establish a reliable and practical assessment system, a secure VQA model capable of resisting such malicious attacks is urgently demanded. Unfortunately, no attempt has been made to explore this issue. This paper first attempts to investigate general adversarial defense principles, aiming at endowing existing VQA models with security. Specifically, we first introduce random spatial grid sampling on the video frame for intra-frame defense. Then, we design pixel-wise randomization through a guardian map, globally neutralizing adversarial perturbations. Meanwhile, we extract temporal information from the video sequence as compensation for inter-frame defense. Building upon these principles, we present a novel VQA framework from the security-oriented perspective, termed SecureVQA. Extensive experiments indicate that SecureVQA sets a new benchmark in security while achieving competitive VQA performance compared with state-of-the-art models. Ablation studies delve deeper into analyzing the principles of SecureVQA, demonstrating their generalization and contributions to the security of leading VQA models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 58 references that are in the map. First posted on arXiv 9 Oct 2024.
Builds on
39 of 58 references.
References · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021Video Swin Transformercited by 1,091
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2020Fast Differentiable Sorting and Rankingcited by 197
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
27 more
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
- 2020Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Trainingcited by 72
- 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
- 2021Adversarial Attacks are Reversible with Natural Supervisioncited by 47
- 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2022DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessmentcited by 41
- 2022Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loopcited by 30
- 2022Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessmentcited by 25
- 2023Zoom-VQA: Patches, Frames and Clips Integration for Video Quality Assessmentcited by 21
- 2023Ada-DQA: Adaptive Diverse Quality-aware Feature Acquisition for Video Quality Assessmentcited by 20
- 2022Universal Perturbation Attack on Differentiable No-Reference Image- and Video-Quality Metricscited by 17
- 2023StableVQA: A Deep No-Reference Quality Assessment Model for Video Stabilitycited by 15
- 2023Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attackscited by 12
- 2024CLIPVQA:Video Quality Assessment via CLIPcited by 11
- 2024Exploring Vulnerabilities of No-Reference Image Quality Assessment Models: A Query-Based Black-Box Methodcited by 10
- 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessmentcited by 10
- 2024Black-box Adversarial Attacks Against Image Quality Assessment Modelscited by 8
- 2023Knowledge Guided Semi-Supervised Learning for Quality Assessment of User Generated Videoscited by 7
- 2024Video Quality Assessment Based on Swin TransformerV2 and Coarse to Fine Strategycited by 6
- 2024Adversarial purification for no-reference image-quality metrics: applicability study and new methodscited by 5
- 2024Ti-Patch: Tiled Physical Adversarial Patch for no-reference video quality metricscited by 4
- 2024Beyond Score Changes: Adversarial Attack on No-Reference Image Quality Assessment from Two Perspectivescited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.