Sparse Adversarial Video Attacks with Spatial Transformations
Not on the map. Why?
Abstract (arXiv)
In recent years, a significant amount of research efforts concentrated on adversarial attacks on images, while adversarial video attacks have seldom been explored. We propose an adversarial attack strategy on videos, called DeepSAVA. Our model includes both additive perturbation and spatial transformation by a unified optimisation framework, where the structural similarity index (SSIM) measure is adopted to measure the adversarial distance. We design an effective and novel optimisation scheme which alternatively utilizes Bayesian optimisation to identify the most influential frame in a video and Stochastic gradient descent (SGD) based optimisation to produce both additive and spatial-transformed perturbations. Doing so enables DeepSAVA to perform a very sparse attack on videos for maintaining human imperceptibility while still achieving state-of-the-art performance in terms of both attack success rate and adversarial transferability. Our intensive experiments on various types of deep neural networks and video datasets confirm the superiority of DeepSAVA.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 42 of its 65 references that are in the map. First posted on arXiv 10 Nov 2021.
Builds on
42 of 65 references.
References · 42
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2013Intriguing properties of neural networkscited by 5,114
- 2014Going Deeper with Convolutionscited by 4,231
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2015Spatial Transformer Networkscited by 1,423
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
30 more
- 2014Long-term Recurrent Convolutional Networks for Visual Recognition and Descriptioncited by 483
- 2017Deep Learning for Medical Image Analysiscited by 399
- 2017Adversarial Examples: Attacks and Defenses for Deep Learningcited by 350
- 2018Generating Adversarial Examples with Adversarial Networkscited by 256
- 2018Human Action Recognition and Prediction: A Surveycited by 226
- 2018Spatially Transformed Adversarial Examplescited by 195
- 2020Perceptual Adversarial Robustness: Defense Against Unseen Threat Modelscited by 137
- 2018Reachability Analysis of Deep Neural Networks with Provable Guaranteescited by 93
- 2019Wasserstein Adversarial Examples via Projected Sinkhorn Iterationscited by 89
- 2019Functional Adversarial Attackscited by 82
- 2019Towards Large yet Imperceptible Adversarial Image Perturbations with Perceptual Color Distancecited by 72
- 2016A Boundary Tilting Persepective on the Phenomenon of Adversarial Examplescited by 70
- 2019Black-box Adversarial Attacks on Video Recognition Modelscited by 58
- 2018Sparse Adversarial Perturbations for Videoscited by 56
- 2018Concolic Testing for Deep Neural Networkscited by 51
- 2018Maximal Jacobian-based Saliency Map Attackcited by 46
- 2019Heuristic Black-box Adversarial Attacks on Video Recognition Modelscited by 37
- 2018A Game-Based Approximate Verification of Deep Neural Networks with Provable Guaranteescited by 33
- 2018Adversarial Perturbations Against Real-Time Video Classification Systemscited by 32
- 2020Sparse Black-box Video Attack with Reinforcement Learningcited by 24
- 2021Adversarial Driving: Attacking End-to-End Autonomous Drivingcited by 19
- 2019Appending Adversarial Frames for Universal Video Attackcited by 17
- 2020Generalizing Universal Adversarial Attacks Beyond Additive Perturbationscited by 17
- 2019Perceptual Evaluation of Adversarial Attacks for CNN-based Image Classificationcited by 12
- 2019Quantifying Perceptual Distortion of Adversarial Examplescited by 10
- 2019Perceptual Quality-preserving Black-Box Attack against Deep Learning Image Classifierscited by 8
- 2021Fooling Object Detectors: Adversarial Attacks by Half-Neighbor Maskscited by 5
- 2021Adversarial Robustness of Deep Learning: Theory, Algorithms, and Applicationscited by 5
- 2020Towards the Quantification of Safety Risks in Deep Neural Networkscited by 4
- 2021Tutorials on Testing Neural Networkscited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 4; 2025: 1.
11 papers.
- 2022Enhancing Adversarial Training with Second-Order Statistics of Weightscited by 42
- 2023Efficient Decision-based Black-box Patch Attacks on Video Recognitioncited by 21
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networkscited by 11
- 2024Boosting Adversarial Training via Fisher-Rao Norm-based Regularizationcited by 7
- 2023Reward Certification for Policy Smoothed Reinforcement Learningcited by 6
- 20223DVerifier: Efficient Robustness Verification for 3D Point Cloud Modelscited by 5
- 2024Seeing is Deceiving: Exploitation of Visual Pathways in Multi-Modal Language Modelscited by 4
- 2024Fine-Grained Alignment in Vision-and-Language Navigation through Bayesian Optimizationcited by 2
- 2021SNEAK: Synonymous Sentences-Aware Adversarial Attack on Natural Language Video Localizationcited by 1
- 2024SVASTIN: Sparse Video Adversarial Attack via Spatio-Temporal Invertible Neural Networkscited by 1
- 2025Adversarial Attacks in Multimodal Systems: A Practitioner's Surveycited by 0
- 2025Adversarial Attacks in Multimodal Systems: A Practitioner's Survey6 May 2025
- 2024Fine-Grained Alignment in Vision-and-Language Navigation through Bayesian Optimization22 Nov 2024
- 2024Seeing is Deceiving: Exploitation of Visual Pathways in Multi-Modal Language Models7 Nov 2024
- 2024SVASTIN: Sparse Video Adversarial Attack via Spatio-Temporal Invertible Neural Networks4 Jun 2024
- 2024Boosting Adversarial Training via Fisher-Rao Norm-based Regularization26 Mar 2024
- 2023Reward Certification for Policy Smoothed Reinforcement Learning11 Dec 2023
- 2023Efficient Decision-based Black-box Patch Attacks on Video Recognition21 Mar 2023
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networks29 Jan 2023
- 20223DVerifier: Efficient Robustness Verification for 3D Point Cloud Models15 Jul 2022
- 2022Enhancing Adversarial Training with Second-Order Statistics of Weights11 Mar 2022
- 2021SNEAK: Synonymous Sentences-Aware Adversarial Attack on Natural Language Video Localization8 Dec 2021