Improving the Robustness of Deep Neural Networks via Stability Training
Not on the map. Why?
Abstract (arXiv)
In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep architectures with state-of-the-art performance on a wide range of computer vision tasks. We present a general stability training method to stabilize deep networks against small input distortions that result from various types of common image processing, such as compression, rescaling, and cropping. We validate our method by stabilizing the state-of-the-art Inception architecture against these types of distortions. In addition, we demonstrate that our stabilized model gives robust state-of-the-art performance on large-scale near-duplicate detection, similar-image ranking, and classification on noisy datasets.
Key facts. Cited by 156 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 53; 2022: 41; 2023: 28; 2024: 20; 2025: 9; 2026: 5.
156 papers.
Sort:
By area:
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
- 2022Test-Time Training with Masked Autoencoderscited by 208
- 2022Dawn of the transformer era in speech emotion recognition: closing the valence gapcited by 155
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2022Hyperbolic Vision Transformers: Combining Improvements in Metric Learningcited by 109
- 2021Model-Based Domain Generalizationcited by 103
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Trainingcited by 89
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 65
- 2021On the Adversarial Robustness of Causal Algorithmic Recoursecited by 56
- 2021RDA: Robust Domain Adaptation via Fourier Adversarial Attackingcited by 48
- 2021A Systematic Review of Robustness in Deep Learning for Computer Vision: Mind the gap?cited by 48
38 more
- 2021Constrained Learning with Non-Convex Lossescited by 42
- 2021When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarkscited by 41
- 2021Consistency Regularization for Cross-Lingual Fine-Tuningcited by 41
- 2021Adversarial Robustness with Semi-Infinite Constrained Learningcited by 39
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2021Benchmarking the Robustness of Spatial-Temporal Models Against Corruptionscited by 35
- 2022An Embarrassingly Simple Backdoor Attack on Self-supervised Learningcited by 30
- 2022A Survey of Deep Graph Clustering: Taxonomy, Challenge, Application, and Open Resourcecited by 26
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2024Text-Guided Attention is All You Need for Zero-Shot Robustness in Vision-Language Modelscited by 23
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 22
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Rank List Sensitivity of Recommender Systems to Interaction Perturbationscited by 20
- 2021"Adversarial Examples" for Proof-of-Learningcited by 19
- 2021Unsupervised Domain Adaptation for Semantic Image Segmentation: a Comprehensive Surveycited by 19
- 2023Erasing, Transforming, and Noising Defense Network for Occluded Person Re-Identificationcited by 19
- 2024Fourier-basis Functions to Bridge Augmentation Gap: Rethinking Frequency Augmentation in Image Classificationcited by 18
- 2022NoisyMix: Boosting Model Robustness to Common Corruptionscited by 17
- 2023False Claims against Model Ownership Resolutioncited by 17
- 2021Regularizing End-to-End Speech Translation with Triangular Decomposition Agreementcited by 16
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2022AirFi: Empowering WiFi-based Passive Human Gesture Recognition to Unseen Environment via Domain Generalizationcited by 15
- 2023Temporal Coherent Test-Time Optimization for Robust Video Classificationcited by 15
- 2022Visual Concepts Tokenizationcited by 14
- 2021Interpreting Attributions and Interactions of Adversarial Attackscited by 13
- 2022Revisiting Sparse Convolutional Model for Visual Recognitioncited by 13
- 2023Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?cited by 13
- 2022Robust and Explainable Identification of Logical Fallacies in Natural Language Argumentscited by 12
- 2022CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parserscited by 11
- 2022Toward Learning Robust and Invariant Representations with Alignment Regularization and Data Augmentationcited by 11
- 2021Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathologycited by 10
- 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPScited by 10
- 2022DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classificationcited by 10
- 2023Deep Learning Safety Concerns in Automated Driving Perceptioncited by 10
- 2024Understanding Hyperbolic Metric Learning through Hard Negative Samplingcited by 10
- 2022Adversarially Robust Learning with Tolerancecited by 9
- 2021Benchmarking the Robustness of Instance Segmentation Modelscited by 8
- 2021ISP Distillationcited by 7
50 most cited of 156 All 156 (JSON)
- 2026Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation30 Sep 2026
- 2026Complementary Text-Guided Attention for Zero-Shot Adversarial Robustness19 Mar 2026
- 2026Post Training Quantization for Efficient Dataset Condensation7 Mar 2026
- 2026CREDIT: Certified Ownership Verification of Deep Neural Networks Against Model Extraction Attacks23 Feb 2026
- 2026Stability as a Liability:Systematic Breakdown of Linguistic Structure in LLMs26 Jan 2026
- 2025C-LEAD: Contrastive Learning for Enhanced Adversarial Defense31 Oct 2025
- 2025Lipschitz-Based Robustness Certification for Recurrent Neural Networks via Convex Relaxation22 Sep 2025
- 2025Processing and acquisition traces in visual encoders: What does CLIP know about your camera?14 Aug 2025
- 2025VoluMe -- Authentic 3D Video Calls from Live Gaussian Splat Prediction28 Jul 2025
- 2025Improving Mixup Calibration with Wasserstein Distributionally Robust Optimization22 Jun 2025
- 2025SNAP: A Benchmark for Testing the Effects of Capture Conditions on Fundamental Vision Tasks21 May 2025
- 2025Test-Time Visual In-Context Tuning27 Mar 2025
38 more
- 2025Enhancing Adversarial Example Detection Through Model Explanation12 Mar 2025
- 2025Boosting Adversarial Robustness and Generalization with Dictionary Structure2 Feb 2025
- 2024Text-Guided Attention is All You Need for Zero-Shot Robustness in Vision-Language Models29 Oct 2024
- 2024Robustness Reprogramming for Representation Learning6 Oct 2024
- 2024Towards certifiable AI in aviation: landscape, challenges, and opportunities13 Sep 2024
- 2024ART: Artifact Removal Transformer for Reconstructing Noise-Free Multichannel Electroencephalographic Signals11 Sep 2024
- 2024Collaboratively Learning Federated Models from Noisy Decentralized Data3 Sep 2024
- 2024Adapting MIMO video restoration networks to low latency constraints22 Aug 2024
- 2024Interpreting Global Perturbation Robustness of Image Models using Axiomatic Spectral Importance Decomposition2 Aug 2024
- 2024Learning Robust Named Entity Recognizers From Noisy Data With Retrieval Augmentation26 Jul 2024
- 2024A Unified Learn-to-Distort-Data Framework for Privacy-Utility Trade-off in Trustworthy Federated Learning5 Jul 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024Enhancing robustness of data-driven SHM models: adversarial training with circle loss20 Jun 2024
- 2024Training More Robust Classification Model via Discriminative Loss and Gaussian Noise Injection28 May 2024
- 2024IB-AdCSCNet:Adaptive Convolutional Sparse Coding Network Driven by Information Bottleneck23 May 2024
- 2024Transparency Distortion Robustness for SOTA Image Segmentation Tasks21 May 2024
- 2024Understanding Hyperbolic Metric Learning through Hard Negative Sampling23 Apr 2024
- 2024Visual Deformation Detection Using Soft Material Simulation for Pre-training of Condition Assessment Models2 Apr 2024
- 2024Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replay2 Apr 2024
- 2024Fourier-basis Functions to Bridge Augmentation Gap: Rethinking Frequency Augmentation in Image Classification4 Mar 2024
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Them22 Jan 2024
- 2024SpecFormer: Guarding Vision Transformer Robustness via Maximum Singular Value Penalization2 Jan 2024
- 2023Having Second Thoughts? Let's hear it26 Nov 2023
- 2023Bridging Generalization Gaps in High Content Imaging Through Online Self-Supervised Domain Adaptation21 Nov 2023
- 2023Bayesian Neural Networks: A Min-Max Game Framework18 Nov 2023
- 2023Towards Improving Robustness Against Common Corruptions using Mixture of Class Specific Experts16 Nov 2023
- 2023Generalization Bounds for Robust Contrastive Learning: From Theory to Practice16 Nov 2023
- 2023Towards Improving Robustness Against Common Corruptions in Object Detectors Using Adversarial Contrastive Learning14 Nov 2023
- 2023A Novel Voronoi-based Convolutional Neural Network Framework for Pushing Person Detection in Crowd Videos11 Oct 2023
- 2023Deep Learning Safety Concerns in Automated Driving Perception7 Sep 2023
- 2023Exploring the Robustness of Human Parsers Towards Common Corruptions2 Sep 2023
- 2023Defending Adversarial Patches via Joint Region Localizing and Inpainting26 Jul 2023
- 2023Rumor Detection with Diverse Counterfactual Evidence18 Jul 2023
- 2023Erasing, Transforming, and Noising Defense Network for Occluded Person Re-Identification14 Jul 2023
- 2023DiffAug: A Diffuse-and-Denoise Augmentation for Training Robust Classifiers15 Jun 2023
- 2023Boosting-based Construction of BDDs for Linear Threshold Functions and Its Application to Verification of Neural Networks8 Jun 2023
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defenses18 May 2023
- 2023Exploiting Frequency Spectrum of Adversarial Images for General Robustness15 May 2023
50 newest of 156 All 156 (JSON)
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
- 2022Scaling Laws for Reward Model Overoptimization19 Oct 2022
- 2022Test-Time Training with Masked Autoencoderscited by 208
- 2022Dawn of the transformer era in speech emotion recognition: closing the valence gapcited by 155
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2022Hyperbolic Vision Transformers: Combining Improvements in Metric Learningcited by 109
- 2021Model-Based Domain Generalizationcited by 103
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Trainingcited by 89
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 65
- 2021On the Adversarial Robustness of Causal Algorithmic Recoursecited by 56
- 2021RDA: Robust Domain Adaptation via Fourier Adversarial Attackingcited by 48
- 2021A Systematic Review of Robustness in Deep Learning for Computer Vision: Mind the gap?cited by 48
- 2021Constrained Learning with Non-Convex Lossescited by 42
12 most cited of 153 All 153 (JSON)
- 2026Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation30 Sep 2026
- 2026Post Training Quantization for Efficient Dataset Condensation7 Mar 2026
- 2026CREDIT: Certified Ownership Verification of Deep Neural Networks Against Model Extraction Attacks23 Feb 2026
- 2026Stability as a Liability:Systematic Breakdown of Linguistic Structure in LLMs26 Jan 2026
- 2025C-LEAD: Contrastive Learning for Enhanced Adversarial Defense31 Oct 2025
- 2025Lipschitz-Based Robustness Certification for Recurrent Neural Networks via Convex Relaxation22 Sep 2025
- 2025Processing and acquisition traces in visual encoders: What does CLIP know about your camera?14 Aug 2025
- 2025VoluMe -- Authentic 3D Video Calls from Live Gaussian Splat Prediction28 Jul 2025
- 2025Improving Mixup Calibration with Wasserstein Distributionally Robust Optimization22 Jun 2025
- 2025SNAP: A Benchmark for Testing the Effects of Capture Conditions on Fundamental Vision Tasks21 May 2025
- 2025Test-Time Visual In-Context Tuning27 Mar 2025
- 2025Enhancing Adversarial Example Detection Through Model Explanation12 Mar 2025
12 newest of 153 All 153 (JSON)