# Progressive Random Convolutions for Single Domain Generalization

arXiv: https://arxiv.org/abs/2304.00424 · HTML: https://mlsanity.com/paper/2304.00424/

## Key facts

- Cited by 34 papers in the map (data through 14 Oct 2026).
- Builds on 58 of its 85 references that are in the map.
- First posted on arXiv 2 Apr 2023.

## Builds on (most cited first, 30 of 58)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [The Cityscapes Dataset for Semantic Urban Scene Understanding](https://mlsanity.com/paper/1604.01685/) (2016)
- [Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification](https://mlsanity.com/paper/1502.01852/) (2015)
- [Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation](https://mlsanity.com/paper/1802.02611/) (2018)
- [RandAugment: Practical automated data augmentation with a reduced search space](https://mlsanity.com/paper/1909.13719/) (2019)
- [Unsupervised Domain Adaptation by Backpropagation](https://mlsanity.com/paper/1409.7495/) (2014)
- [The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization](https://mlsanity.com/paper/2006.16241/) (2020)
- [Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World](https://mlsanity.com/paper/1703.06907/) (2017)
- [Deformable Convolutional Networks](https://mlsanity.com/paper/1703.06211/) (2017)
- [Spatial Transformer Networks](https://mlsanity.com/paper/1506.02025/) (2015)
- [BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning](https://mlsanity.com/paper/1805.04687/) (2018)
- [Deep Hashing Network for Unsupervised Domain Adaptation](https://mlsanity.com/paper/1706.07522/) (2017)
- [CyCADA: Cycle-Consistent Adversarial Domain Adaptation](https://mlsanity.com/paper/1711.03213/) (2017)
- [In Search of Lost Domain Generalization](https://mlsanity.com/paper/2007.01434/) (2020)
- [Deeper, Broader and Artier Domain Generalization](https://mlsanity.com/paper/1710.03077/) (2017)
- [Playing for Data: Ground Truth from Computer Games](https://mlsanity.com/paper/1608.02192/) (2016)
- [Domain Generalization via Invariant Feature Representation](https://mlsanity.com/paper/1301.2115/) (2013)
- [Understanding the Effective Receptive Field in Deep Convolutional Neural Networks](https://mlsanity.com/paper/1701.04128/) (2017)
- [Measuring Robustness to Natural Distribution Shifts in Image Classification](https://mlsanity.com/paper/2007.00644/) (2020)
- [Generalizing to Unseen Domains via Adversarial Data Augmentation](https://mlsanity.com/paper/1805.12018/) (2018)
- [Domain Generalization by Solving Jigsaw Puzzles](https://mlsanity.com/paper/1903.06864/) (2019)
- [Domain Generalization via Model-Agnostic Learning of Semantic Features](https://mlsanity.com/paper/1910.13580/) (2019)
- [Wasserstein Auto-Encoders](https://mlsanity.com/paper/1711.01558/) (2017)
- [Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net](https://mlsanity.com/paper/1807.09441/) (2018)
- [Unified Deep Supervised Domain Adaptation and Generalization](https://mlsanity.com/paper/1709.10190/) (2017)
- [Learning to Learn Single Domain Generalization](https://mlsanity.com/paper/2003.13216/) (2020)
- [Learning to Generate Novel Domains for Domain Generalization](https://mlsanity.com/paper/2007.03304/) (2020)
- [A Fourier-based Framework for Domain Generalization](https://mlsanity.com/paper/2105.11120/) (2021)
- [Domain Generalization for Object Recognition with Multi-task Autoencoders](https://mlsanity.com/paper/1508.07680/) (2015)
- [Domain Randomization and Pyramid Consistency: Simulation-to-Real Generalization without Accessing Target Domain Data](https://mlsanity.com/paper/1909.00889/) (2019)

## Built on by (most cited first, 30 of 34)

- [Prompt-Driven Dynamic Object-Centric Learning for Single Domain Generalization](https://mlsanity.com/paper/2402.18447/) (2024)
- [Diversifying Spatial-Temporal Perception for Video Domain Generalization](https://mlsanity.com/paper/2310.17942/) (2023)
- [PracticalDG: Perturbation Distillation on Vision-Language Models for Hybrid Domain Generalization](https://mlsanity.com/paper/2404.09011/) (2024)
- [CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey](https://mlsanity.com/paper/2504.14280/) (2025)
- [MRFP: Learning Generalizable Semantic Segmentation from Sim-2-Real with Multi-Resolution Feature Perturbation](https://mlsanity.com/paper/2311.18331/) (2023)
- [Gradient-Guided Annealing for Domain Generalization](https://mlsanity.com/paper/2502.20162/) (2025)
- [Reasoning-Driven Multimodal LLM for Domain Generalization](https://mlsanity.com/paper/2602.23777/) (2026)
- [Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlations](https://mlsanity.com/paper/2401.05752/) (2024)
- [StyDeSty: Min-Max Stylization and Destylization for Single Domain Generalization](https://mlsanity.com/paper/2406.00275/) (2024)
- [Beyond Finite Data: Towards Data-free Out-of-distribution Generalization via Extrapolation](https://mlsanity.com/paper/2403.05523/) (2024)
- [Feature Diversification and Adaptation for Federated Domain Generalization](https://mlsanity.com/paper/2407.08245/) (2024)
- [Crafting Distribution Shifts for Validation and Training in Single Source Domain Generalization](https://mlsanity.com/paper/2409.19774/) (2024)
- [ICPR 2024 Competition on Multiple Sclerosis Lesion Segmentation -- Methods and Results](https://mlsanity.com/paper/2410.07924/) (2024)
- [Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization](https://mlsanity.com/paper/2606.21736/) (2026)
- [A Novel Cross-Perturbation for Single Domain Generalization](https://mlsanity.com/paper/2308.00918/) (2023)
- [FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalization](https://mlsanity.com/paper/2409.14671/) (2024)
- [Domain Adversarial Active Learning for Domain Generalization Classification](https://mlsanity.com/paper/2403.06174/) (2024)
- [TIDE: Training Locally Interpretable Domain Generalization Models Enables Test-time Correction](https://mlsanity.com/paper/2411.16788/) (2024)
- [FedSemiDG: Domain Generalized Federated Semi-supervised Medical Image Segmentation](https://mlsanity.com/paper/2501.07378/) (2025)
- [Augmentation-based Domain Generalization and Joint Training from Multiple Source Domains for Whole Heart Segmentation](https://mlsanity.com/paper/2508.04552/) (2025)
- [Causality-inspired Latent Feature Augmentation for Single Domain Generalization](https://mlsanity.com/paper/2406.05980/) (2024)
- [Style Content Decomposition-based Data Augmentation for Domain Generalizable Medical Image Segmentation](https://mlsanity.com/paper/2502.20619/) (2025)
- [Pseudo Multi-Source Domain Generalization: Bridging the Gap Between Single and Multi-Source Domain Generalization](https://mlsanity.com/paper/2505.23173/) (2025)
- [Prototypical Progressive Alignment and Reweighting for Generalizable Semantic Segmentation](https://mlsanity.com/paper/2507.11955/) (2025)
- [Ivan-ISTD: Rethinking Cross-domain Heteroscedastic Noise Perturbations in Infrared Small Target Detection](https://mlsanity.com/paper/2510.12241/) (2025)
- [Shoe Style-Invariant and Ground-Aware Learning for Dense Foot Contact Estimation](https://mlsanity.com/paper/2511.22184/) (2025)
- [Spectral Property-Driven Data Augmentation for Hyperspectral Single-Source Domain Generalization](https://mlsanity.com/paper/2603.16662/) (2026)
- [Casual Inference via Style Bias Deconfounding for Domain Generalization](https://mlsanity.com/paper/2503.16852/) (2025)
- [Vision and Language Integration for Domain Generalization](https://mlsanity.com/paper/2504.12966/) (2025)
- [Semantic-aware Random Convolution and Source Matching for Domain Generalization in Medical Image Segmentation](https://mlsanity.com/paper/2512.01510/) (2025)

## Abstract (arXiv)

Single domain generalization aims to train a generalizable model with only one source domain to perform well on arbitrary unseen target domains. Image augmentation based on Random Convolutions (RandConv), consisting of one convolution layer randomly initialized for each mini-batch, enables the model to learn generalizable visual representations by distorting local textures despite its simple and lightweight structure. However, RandConv has structural limitations in that the generated image easily loses semantics as the kernel size increases, and lacks the inherent diversity of a single convolution operation. To solve the problem, we propose a Progressive Random Convolution (Pro-RandConv) method that recursively stacks random convolution layers with a small kernel size instead of increasing the kernel size. This progressive approach can not only mitigate semantic distortions by reducing the influence of pixels away from the center in the theoretical receptive field, but also create more effective virtual domains by gradually increasing the style diversity. In addition, we develop a basic random convolution layer into a random convolution block including deformable offsets and affine transformation to support texture and contrast diversification, both of which are also randomly initialized. Without complex generators or adversarial learning, we demonstrate that our simple yet effective augmentation strategy outperforms state-of-the-art methods on single domain generalization benchmarks.
