Out-of-Domain Generalization from a Single Source: An Uncertainty Quantification Approach
Not on the map. Why?
Abstract (arXiv)
We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose Meta-Learning based Adversarial Domain Augmentation to solve this Out-of-Domain generalization problem. The key idea is to leverage adversarial training to create "fictitious" yet "challenging" populations, from which a model can learn to generalize with theoretical guarantees. To facilitate fast and desirable domain augmentation, we cast the model training in a meta-learning scheme and use a Wasserstein Auto-Encoder to relax the widely used worst-case constraint. We further improve our method by integrating uncertainty quantification for efficient domain generalization. Extensive experiments on multiple benchmark datasets indicate its superior performance in tackling single domain generalization.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 57 of its 96 references that are in the map. First posted on arXiv 5 Aug 2021.
Builds on
57 of 96 references.
References · 57
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Wide Residual Networkscited by 3,057
38 more
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
- 2017Wasserstein Auto-Encoderscited by 371
- 2017Certifying Some Distributional Robustness with Principled Adversarial Trainingcited by 333
- 2017Unified Deep Supervised Domain Adaptation and Generalizationcited by 322
- 2020Learning to Learn Single Domain Generalizationcited by 295
- 2016Learning from Simulated and Unsupervised Images through Adversarial Trainingcited by 287
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
- 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
- 2018A DIRT-T Approach to Unsupervised Domain Adaptationcited by 215
- 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
- 2016Learning to Optimizecited by 195
- 2018Bayesian Model-Agnostic Meta-Learningcited by 194
- 2017Generate To Adapt: Aligning Domains using Generative Adversarial Networkscited by 183
- 2018Recasting Gradient-Based Meta-Learning as Hierarchical Bayescited by 180
- 2017Image to Image Translation for Domain Adaptationcited by 171
- 2018Disentangling Adversarial Robustness and Generalizationcited by 171
- 2017Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Graspingcited by 138
- 2020Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustnesscited by 121
- 2017Few-Shot Adversarial Domain Adaptationcited by 111
- 2017Learning to Compose Domain-Specific Transformations for Data Augmentationcited by 91
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 7; 2024: 6; 2025: 2; 2026: 2.
18 papers.
Sort:
- 2023Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentationcited by 29
- 2023Frequency-mixed Single-source Domain Generalization for Medical Image Segmentationcited by 20
- 2023Modality-Agnostic Debiasing for Single Domain Generalizationcited by 14
- 2023Are Data-driven Explanations Robust against Out-of-distribution Data?cited by 14
- 2024Uncertainty-guided Contrastive Learning for Single Source Domain Generalisationcited by 14
- 2023Topology-aware Robust Optimization for Out-of-distribution Generalizationcited by 7
- 2022Towards Optimization and Model Selection for Domain Generalization: A Mixup-guided Solutioncited by 6
- 2024SeafloorAI: A Large-scale Vision-Language Dataset for Seafloor Geological Surveycited by 6
- 2025When Domain Generalization meets Generalized Category Discovery: An Adaptive Task-Arithmetic Driven Approachcited by 5
- 2024RaffeSDG: Random Frequency Filtering enabled Single-source Domain Generalization for Medical Image Segmentationcited by 3
- 2024FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalizationcited by 3
- 2024Domain Expansion and Boundary Growth for Open-Set Single-Source Domain Generalizationcited by 2
6 more
- 2023Calibration-based Dual Prototypical Contrastive Learning Approach for Domain Generalization Semantic Segmentationcited by 1
- 2024Producing Plankton Classifiers that are Robust to Dataset Shiftcited by 1
- 2023HD Maps are Lane Detection Generalizers: A Novel Generative Framework for Single-Source Domain Generalizationcited by 0
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality imagescited by 0
- 2026FOCUS: Bridging Fine-Grained Recognition and Open-World Discovery across Domainscited by 0
- 2026VFM4SDG: Unveiling the Power of VFMs for Single-Domain Generalized Object Detectioncited by 0
- 2026VFM4SDG: Unveiling the Power of VFMs for Single-Domain Generalized Object Detection23 Apr 2026
- 2026FOCUS: Bridging Fine-Grained Recognition and Open-World Discovery across Domains15 Mar 2026
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality images24 May 2025
- 2025When Domain Generalization meets Generalized Category Discovery: An Adaptive Task-Arithmetic Driven Approach19 Mar 2025
- 2024Domain Expansion and Boundary Growth for Open-Set Single-Source Domain Generalization5 Nov 2024
- 2024SeafloorAI: A Large-scale Vision-Language Dataset for Seafloor Geological Survey31 Oct 2024
- 2024FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalization23 Sep 2024
- 2024RaffeSDG: Random Frequency Filtering enabled Single-source Domain Generalization for Medical Image Segmentation2 May 2024
- 2024Uncertainty-guided Contrastive Learning for Single Source Domain Generalisation12 Mar 2024
- 2024Producing Plankton Classifiers that are Robust to Dataset Shift25 Jan 2024
- 2023HD Maps are Lane Detection Generalizers: A Novel Generative Framework for Single-Source Domain Generalization28 Nov 2023
- 2023Calibration-based Dual Prototypical Contrastive Learning Approach for Domain Generalization Semantic Segmentation25 Sep 2023
6 more
- 2023Topology-aware Robust Optimization for Out-of-distribution Generalization26 Jul 2023
- 2023Frequency-mixed Single-source Domain Generalization for Medical Image Segmentation18 Jul 2023
- 2023Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentation1 Jul 2023
- 2023Are Data-driven Explanations Robust against Out-of-distribution Data?29 Mar 2023
- 2023Modality-Agnostic Debiasing for Single Domain Generalization13 Mar 2023
- 2022Towards Optimization and Model Selection for Domain Generalization: A Mixup-guided Solution1 Sep 2022
- 2023Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentationcited by 29
- 2023Frequency-mixed Single-source Domain Generalization for Medical Image Segmentationcited by 20
- 2023Modality-Agnostic Debiasing for Single Domain Generalizationcited by 14
- 2023Are Data-driven Explanations Robust against Out-of-distribution Data?cited by 14
- 2024Uncertainty-guided Contrastive Learning for Single Source Domain Generalisationcited by 14
- 2023Topology-aware Robust Optimization for Out-of-distribution Generalizationcited by 7
- 2022Towards Optimization and Model Selection for Domain Generalization: A Mixup-guided Solutioncited by 6
- 2024SeafloorAI: A Large-scale Vision-Language Dataset for Seafloor Geological Surveycited by 6
- 2025When Domain Generalization meets Generalized Category Discovery: An Adaptive Task-Arithmetic Driven Approachcited by 5
- 2024RaffeSDG: Random Frequency Filtering enabled Single-source Domain Generalization for Medical Image Segmentationcited by 3
- 2024FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalizationcited by 3
- 2024Domain Expansion and Boundary Growth for Open-Set Single-Source Domain Generalizationcited by 2
12 most cited of 18 All 18 (JSON)
- 2026VFM4SDG: Unveiling the Power of VFMs for Single-Domain Generalized Object Detection23 Apr 2026
- 2026FOCUS: Bridging Fine-Grained Recognition and Open-World Discovery across Domains15 Mar 2026
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality images24 May 2025
- 2025When Domain Generalization meets Generalized Category Discovery: An Adaptive Task-Arithmetic Driven Approach19 Mar 2025
- 2024Domain Expansion and Boundary Growth for Open-Set Single-Source Domain Generalization5 Nov 2024
- 2024SeafloorAI: A Large-scale Vision-Language Dataset for Seafloor Geological Survey31 Oct 2024
- 2024FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalization23 Sep 2024
- 2024RaffeSDG: Random Frequency Filtering enabled Single-source Domain Generalization for Medical Image Segmentation2 May 2024
- 2024Uncertainty-guided Contrastive Learning for Single Source Domain Generalisation12 Mar 2024
- 2024Producing Plankton Classifiers that are Robust to Dataset Shift25 Jan 2024
- 2023HD Maps are Lane Detection Generalizers: A Novel Generative Framework for Single-Source Domain Generalization28 Nov 2023
- 2023Calibration-based Dual Prototypical Contrastive Learning Approach for Domain Generalization Semantic Segmentation25 Sep 2023
12 newest of 18 All 18 (JSON)