Analysis and Extensions of Adversarial Training for Video Classification
Not on the map. Why?
Abstract (arXiv)
Adversarial training (AT) is a simple yet effective defense against adversarial attacks to image classification systems, which is based on augmenting the training set with attacks that maximize the loss. However, the effectiveness of AT as a defense for video classification has not been thoroughly studied. Our first contribution is to show that generating optimal attacks for video requires carefully tuning the attack parameters, especially the step size. Notably, we show that the optimal step size varies linearly with the attack budget. Our second contribution is to show that using a smaller (sub-optimal) attack budget at training time leads to a more robust performance at test time. Based on these findings, we propose three defenses against attacks with variable attack budgets. The first one, Adaptive AT, is a technique where the attack budget is drawn from a distribution that is adapted as training iterations proceed. The second, Curriculum AT, is a technique where the attack budget is increased as training iterations proceed. The third, Generative AT, further couples AT with a denoising generative adversarial network to boost robust performance. Experiments on the UCF101 dataset demonstrate that the proposed methods improve adversarial robustness against multiple attack types.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 16 Jun 2022.
Builds on
38 of 46 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2016Adversarial Machine Learning at Scalecited by 934
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
26 more
- 2016Pixel Recurrent Neural Networkscited by 814
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2017Countering Adversarial Images using Input Transformationscited by 517
- 2020Overfitting in adversarially robust deep learningcited by 504
- 2018Defense-GAN: Protecting Classifiers Against Adversarial Attacks Using Generative Modelscited by 362
- 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 308
- 2017PixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examplescited by 243
- 2020Attacks Which Do Not Kill Training Make Adversarial Learning Strongercited by 242
- 2018Adversarial Robustness Toolbox v1.0.0cited by 214
- 2019Adversarial Training and Robustness for Multiple Perturbationscited by 182
- 2018Stochastic Activation Pruning for Robust Adversarial Defensecited by 171
- 2018Towards the first adversarially robust neural network model on MNISTcited by 104
- 2016Spatiotemporal Residual Networks for Video Action Recognitioncited by 91
- 2018Curriculum Adversarial Trainingcited by 89
- 2015Learning with a Strong Adversarycited by 68
- 2019Black-box Adversarial Attacks on Video Recognition Modelscited by 58
- 2017APE-GAN: Adversarial Perturbation Elimination with GANcited by 57
- 2018Sparse Adversarial Perturbations for Videoscited by 56
- 2020Dual Manifold Adversarial Robustness: Defense against Lp and non-Lp Adversarial Attackscited by 45
- 2020Over-the-Air Adversarial Flickering Attacks against Video Recognition Networkscited by 35
- 2020Would Mega-scale Datasets Further Enhance Spatiotemporal 3D CNNs?cited by 31
- 2017Attacking the Madry Defense Model with L1-based Adversarial Examplescited by 21
- 2018Procedural Noise Adversarial Examples for Black-Box Attacks on Deep Convolutional Networkscited by 21
- 2020Defending Against Multiple and Unforeseen Adversarial Videoscited by 19
- 2018Adversarial Attacks for Optical Flow-Based Action Recognition Classifierscited by 14
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 6; 2025: 2; 2026: 1.
11 papers.
- 2024R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Modelcited by 56
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videoscited by 9
- 2024Adversarial Training: A Surveycited by 6
- 2024Can Implicit Bias Imply Adversarial Robustness?cited by 5
- 2024Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perceptioncited by 5
- 2025VideoPure: Diffusion-based Adversarial Purification for Video Recognitioncited by 5
- 2023Improve Video Representation with Temporal Adversarial Augmentationcited by 3
- 2026Exposing and Defending the Achilles' Heel of Video Mixture-of-Expertscited by 3
- 2022Adversarially Robust Video Perception by Seeing Motioncited by 2
- 2024Adaptive Batch Normalization Networks for Adversarial Robustnesscited by 1
- 2024Adversarial Robustness in RGB-Skeleton Action Recognition: Leveraging Attention Modality Reweightercited by 0
- 2026Exposing and Defending the Achilles' Heel of Video Mixture-of-Experts1 Feb 2026
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videos21 Apr 2025
- 2025VideoPure: Diffusion-based Adversarial Purification for Video Recognition25 Jan 2025
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024Adversarial Robustness in RGB-Skeleton Action Recognition: Leveraging Attention Modality Reweighter29 Jul 2024
- 2024Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perception26 May 2024
- 2024R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Model25 May 2024
- 2024Can Implicit Bias Imply Adversarial Robustness?24 May 2024
- 2024Adaptive Batch Normalization Networks for Adversarial Robustness20 May 2024
- 2023Improve Video Representation with Temporal Adversarial Augmentation28 Apr 2023
- 2022Adversarially Robust Video Perception by Seeing Motion13 Dec 2022