mlsanityData to 7 Oct 2026

TripleE: Easy Domain Generalization via Episodic Replay

arXiv 2210.01807 ↗First posted 4 Oct 2022cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning how to generalize the model to unseen domains is an important area of research. In this paper, we propose TripleE, and the main idea is to encourage the network to focus on training on subsets (learning with replay) and enlarge the data space in learning on subsets. Learning with replay contains two core designs, EReplayB and EReplayD, which conduct the replay schema on batch and dataset, respectively. Through this, the network can focus on learning with subsets instead of visiting the global set at a glance, enlarging the model diversity in ensembling. To enlarge the data space in learning on subsets, we verify that an exhaustive and singular augmentation (ESAug) performs surprisingly well on expanding the data space in subsets during replays. Our model dubbed TripleE is frustratingly easy, based on simple augmentation and ensembling. Without bells and whistles, our TripleE method surpasses prior arts on six domain generalization benchmarks, showing that this approach could serve as a stepping stone for future research in domain generalization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 67 references that are in the map. First posted on arXiv 4 Oct 2022.

Builds on

53 of 67 references.

References · 53

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Densely Connected Convolutional Networkscited by 6,691
  4. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  5. 2020Supervised Contrastive Learningcited by 2,803
  6. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  7. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  8. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
  9. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  10. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
  11. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
  12. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
38 more
  1. 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
  2. 2020In Search of Lost Domain Generalizationcited by 1,042
  3. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
  4. 2017Deeper, Broader and Artier Domain Generalizationcited by 983
  5. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
  6. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  7. 2018Recognition in Terra Incognitacited by 655
  8. 2021Domain Generalization with MixStylecited by 563
  9. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  10. 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
  11. 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
  12. 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
  13. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
  14. 2017Unified Deep Supervised Domain Adaptation and Generalizationcited by 322
  15. 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
  16. 2021A Fourier-based Framework for Domain Generalizationcited by 287
  17. 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
  18. 2021Gradient Matching for Domain Generalizationcited by 258
  19. 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
  20. 2019Episodic Training for Domain Generalizationcited by 245
  21. 2019Domain Randomization and Pyramid Consistency: Simulation-to-Real Generalization without Accessing Target Domain Datacited by 245
  22. 2019Fast AutoAugmentcited by 243
  23. 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
  24. 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 225
  25. 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
  26. 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
  27. 2022Domain Generalization by Mutual-Information Regularization with Pre-trained Modelscited by 133
  28. 2020Learning to Balance Specificity and Invariance for In and Out of Domain Generalizationcited by 128
  29. 2019Learning Robust Representations by Projecting Superficial Statistics Outcited by 123
  30. 2016Fully Convolutional Instance-aware Semantic Segmentationcited by 122
  31. 2017A Review on Deep Learning Techniques Applied to Semantic Segmentationcited by 122
  32. 2020Learning from Extrinsic and Intrinsic Supervisions for Domain Generalizationcited by 108
  33. 2018Revisiting Small Batch Training for Deep Neural Networkscited by 100
  34. 2020Permuted AdaIN: Reducing the Bias Towards Global Statistics in Image Classificationcited by 63
  35. 2018Domain Generalization with Domain-Specific Aggregation Modulescited by 61
  36. 2020Informative Dropout for Robust Representation Learning: A Shape-bias Perspectivecited by 57
  37. 2020Towards Recognizing Unseen Categories in Unseen Domainscited by 56
  38. 2019DeceptionNet: Network-Driven Domain Randomizationcited by 43

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.