Stress-Aware Resilient Neural Training
Not on the map. Why?
Abstract (arXiv)
This paper introduces Stress-Aware Learning, a resilient neural training paradigm in which deep neural networks dynamically adjust their optimization behavior - whether under stable training regimes or in settings with uncertain dynamics - based on the concept of Temporary (Elastic) and Permanent (Plastic) Deformation, inspired by structural fatigue in materials science. To instantiate this concept, we propose Plastic Deformation Optimizer, a stress-aware mechanism that injects adaptive noise into model parameters whenever an internal stress signal - reflecting stagnation in training loss and accuracy - indicates persistent optimization difficulty. This enables the model to escape sharp minima and converge toward flatter, more generalizable regions of the loss landscape. Experiments across six architectures, four optimizers, and seven vision benchmarks demonstrate improved robustness and generalization with minimal computational overhead. The code and 3D visuals will be available on GitHub: https://github.com/Stress-Aware-Learning/SAL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 47 references that are in the map. First posted on arXiv 31 Jul 2025.
Builds on
19 of 47 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
- 2016An overview of gradient descent optimization algorithmscited by 1,033
- 2017Deeper, Broader and Artier Domain Generalizationcited by 986
- 2016Deep Networks with Stochastic Depthcited by 979
7 more
- 2016Entropy-SGD: Biasing Gradient Descent Into Wide Valleyscited by 359
- 2017Online Learning Rate Adaptation with Hypergradient Descentcited by 118
- 2018Improving DNN Robustness to Adversarial Attacks using Jacobian Regularizationcited by 88
- 2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesiscited by 41
- 2025VeLU: Variance-enhanced Learning Unit for Deep Neural Networkscited by 1
- 2025DepViT-CAD: Deployable Vision Transformer-Based Cancer Diagnosis in Histopathologycited by 1
- 2025Unit-Based Histopathology Tissue Segmentation via Multi-Level Feature Representationcited by 1
Built on by
Not cited yet.