Adversarial Data Augmentation for Single Domain Generalization via Lyapunov Exponent-Guided Optimization
Not on the map. Why?
Abstract (arXiv)
Single Domain Generalization (SDG) aims to develop models capable of generalizing to unseen target domains using only one source domain, a task complicated by substantial domain shifts and limited data diversity. Existing SDG approaches primarily rely on data augmentation techniques, which struggle to effectively adapt training dynamics to accommodate large domain shifts. To address this, we propose LEAwareSGD, a novel Lyapunov Exponent (LE)-guided optimization approach inspired by dynamical systems theory. By leveraging LE measurements to modulate the learning rate, LEAwareSGD encourages model training near the edge of chaos, a critical state that optimally balances stability and adaptability. This dynamic adjustment allows the model to explore a wider parameter space and capture more generalizable features, ultimately enhancing the model's generalization capability. Extensive experiments on PACS, OfficeHome, and DomainNet demonstrate that LEAwareSGD yields substantial generalization gains, achieving up to 9.47% improvement on PACS in low-data regimes. These results underscore the effectiveness of training near the edge of chaos for enhancing model generalization capability in SDG tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 6 Jul 2025.
Builds on
34 of 52 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2017Deeper, Broader and Artier Domain Generalizationcited by 986
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 552
22 more
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
- 2020Learning to Learn Single Domain Generalizationcited by 296
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2020Improve Unsupervised Domain Adaptation with Mixup Trainingcited by 185
- 2022Surrogate Gap Minimization Improves Sharpness-Aware Trainingcited by 172
- 2021Learning to Diversify for Single Domain Generalizationcited by 170
- 2020Robust and Generalizable Visual Representation Learning via Random Convolutionscited by 142
- 2019Deep Learning for Hyperspectral Image Classification: An Overviewcited by 123
- 2020Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustnesscited by 121
- 2023Sharpness-Aware Gradient Matching for Domain Generalizationcited by 102
- 2021Progressive Domain Expansion Network for Single Domain Generalizationcited by 97
- 2019Deep Learning via Dynamical Systems: An Approximation Perspectivecited by 78
- 2021MixStyle Neural Networks for Domain Generalization and Adaptationcited by 64
- 2022Attention Consistency on Visual Corruptions for Single-Source Domain Generalizationcited by 37
- 2020On Lyapunov Exponents for RNNs: Understanding Information Propagation Using Dynamical Systems Toolscited by 31
- 2019Deep Learning Theory Review: An Optimal Control and Dynamical Systems Perspectivecited by 27
- 2023Flatness-Aware Minimization for Domain Generalizationcited by 27
- 2023Adversarial Bayesian Augmentation for Single-Source Domain Generalizationcited by 22
- 2023AdvST: Revisiting Data Augmentations for Single Domain Generalizationcited by 16
- 2021Edge of chaos as a guiding principle for modern neural network trainingcited by 10
- 2019Optimal Machine Intelligence at the Edge of Chaoscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.