TripleE: Easy Domain Generalization via Episodic Replay
Not on the map. Why?
Abstract (arXiv)
Learning how to generalize the model to unseen domains is an important area of research. In this paper, we propose TripleE, and the main idea is to encourage the network to focus on training on subsets (learning with replay) and enlarge the data space in learning on subsets. Learning with replay contains two core designs, EReplayB and EReplayD, which conduct the replay schema on batch and dataset, respectively. Through this, the network can focus on learning with subsets instead of visiting the global set at a glance, enlarging the model diversity in ensembling. To enlarge the data space in learning on subsets, we verify that an exhaustive and singular augmentation (ESAug) performs surprisingly well on expanding the data space in subsets during replays. Our model dubbed TripleE is frustratingly easy, based on simple augmentation and ensembling. Without bells and whistles, our TripleE method surpasses prior arts on six domain generalization benchmarks, showing that this approach could serve as a stepping stone for future research in domain generalization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 67 references that are in the map. First posted on arXiv 4 Oct 2022.
Builds on
53 of 67 references.
References · 53
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2020Supervised Contrastive Learningcited by 2,803
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
38 more
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
- 2020In Search of Lost Domain Generalizationcited by 1,042
- 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2018Recognition in Terra Incognitacited by 655
- 2021Domain Generalization with MixStylecited by 563
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
- 2017Unified Deep Supervised Domain Adaptation and Generalizationcited by 322
- 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
- 2021A Fourier-based Framework for Domain Generalizationcited by 287
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
- 2019Episodic Training for Domain Generalizationcited by 245
- 2019Domain Randomization and Pyramid Consistency: Simulation-to-Real Generalization without Accessing Target Domain Datacited by 245
- 2019Fast AutoAugmentcited by 243
- 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 225
- 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
- 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
- 2022Domain Generalization by Mutual-Information Regularization with Pre-trained Modelscited by 133
- 2020Learning to Balance Specificity and Invariance for In and Out of Domain Generalizationcited by 128
- 2019Learning Robust Representations by Projecting Superficial Statistics Outcited by 123
- 2016Fully Convolutional Instance-aware Semantic Segmentationcited by 122
- 2017A Review on Deep Learning Techniques Applied to Semantic Segmentationcited by 122
- 2020Learning from Extrinsic and Intrinsic Supervisions for Domain Generalizationcited by 108
- 2018Revisiting Small Batch Training for Deep Neural Networkscited by 100
- 2020Permuted AdaIN: Reducing the Bias Towards Global Statistics in Image Classificationcited by 63
- 2018Domain Generalization with Domain-Specific Aggregation Modulescited by 61
- 2020Informative Dropout for Robust Representation Learning: A Shape-bias Perspectivecited by 57
- 2020Towards Recognizing Unseen Categories in Unseen Domainscited by 56
- 2019DeceptionNet: Network-Driven Domain Randomizationcited by 43
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.