Is Generative Modeling-based Stylization Necessary for Domain Adaptation in Regression Tasks?
Not on the map. Why?
Abstract (arXiv)
Unsupervised domain adaptation (UDA) aims to bridge the gap between source and target domains in the absence of target domain labels using two main techniques: input-level alignment (such as generative modeling and stylization) and feature-level alignment (which matches the distribution of the feature maps, e.g. gradient reversal layers). Motivated from the success of generative modeling for image classification, stylization-based methods were recently proposed for regression tasks, such as pose estimation. However, use of input-level alignment via generative modeling and stylization incur additional overhead and computational complexity which limit their use in real-world DA tasks. To investigate the role of input-level alignment for DA, we ask the following question: Is generative modeling-based stylization necessary for visual domain adaptation in regression? Surprisingly, we find that input-alignment has little effect on regression tasks as compared to classification. Based on these insights, we develop a non-parametric feature-level domain alignment method -- Implicit Stylization (ImSty) -- which results in consistent improvements over SOTA regression task, without the need for computationally intensive stylization and generative modeling. Our work conducts a critical evaluation of the role of generative modeling and stylization, at a time when these are also gaining popularity for domain generalization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 2 Jun 2023.
Builds on
35 of 51 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2016Deep Transfer Learning with Joint Adaptation Networkscited by 609
- 2021Domain Generalization with MixStylecited by 563
- 2019Contrastive Adaptation Network for Unsupervised Domain Adaptationcited by 407
- 2017Learning from Synthetic Humanscited by 358
- 2016Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networkscited by 307
- 2020A Brief Review of Domain Adaptationcited by 287
- 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
- 2019Domain-Specific Batch Normalization for Unsupervised Domain Adaptationcited by 197
23 more
- 2017Generate To Adapt: Aligning Domains using Generative Adversarial Networkscited by 183
- 2021Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Datacited by 152
- 2017Domain Adaptation for Visual Applications: A Comprehensive Surveycited by 127
- 2018DCAN: Dual Channel-wise Alignment Networks for Unsupervised Scene Adaptationcited by 101
- 2019HoMM: Higher-order Moment Matching for Unsupervised Domain Adaptationcited by 89
- 2016Beyond Sharing Weights for Deep Domain Adaptationcited by 80
- 2017AutoDIAL: Automatic DomaIn Alignment Layerscited by 75
- 2019Learning from Synthetic Animalscited by 65
- 2017From source to target and back: symmetric bi-directional adaptive GANcited by 53
- 2021From Synthetic to Real: Unsupervised Domain Adaptation for Animal Pose Estimationcited by 48
- 2020Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Surveycited by 47
- 2019Pseudo-Labeling Curriculum for Unsupervised Domain Adaptationcited by 46
- 2021Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iteratecited by 43
- 2021One-Shot Generative Domain Adaptationcited by 41
- 2021Regressive Domain Adaptation for Unsupervised Keypoint Detectioncited by 34
- 2022Generative Domain Adaptation for Face Anti-Spoofingcited by 33
- 2020Importance-Aware Semantic Segmentation in Self-Driving with Discrete Wasserstein Trainingcited by 27
- 2021In the light of feature distributions: moment matching for Neural Style Transfercited by 26
- 2022A Unified Framework for Domain Adaptive Pose Estimationcited by 20
- 2014Articulated motion discovery using pairs of trajectoriescited by 13
- 2020Unsupervised Domain Adaptation for Person Re-Identification through Source-Guided Pseudo-Labelingcited by 12
- 2018Unsupervised Domain Adaptation: from Simulation Engine to the RealWorldcited by 2
- 2021Multiple Classifiers Based Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 2
Built on by
Not cited yet.