# Attract, Perturb, and Explore: Learning a Feature Alignment Network for Semi-supervised Domain Adaptation

arXiv: https://arxiv.org/abs/2007.09375 · HTML: https://mlsanity.com/paper/2007.09375/

## Key facts

- Cited by 69 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Jul 2020.

## Built on by (most cited first, 30 of 69)

- [Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives](https://mlsanity.com/paper/2208.07422/) (2022)
- [Transfer Learning from Synthetic to Real LiDAR Point Cloud for Semantic Segmentation](https://mlsanity.com/paper/2107.05399/) (2021)
- [Cross-Domain Adaptive Clustering for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2104.09415/) (2021)
- [CLDA: Contrastive Learning for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2107.00085/) (2021)
- [FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heterogeneity in Federated Learning](https://mlsanity.com/paper/2401.03230/) (2024)
- [Multi-Objective Meta Learning](https://mlsanity.com/paper/2102.07121/) (2021)
- [Semi-supervised Domain Adaptation based on Dual-level Domain Mixing for Semantic Segmentation](https://mlsanity.com/paper/2103.04705/) (2021)
- [ECACL: A Holistic Framework for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2104.09136/) (2021)
- [Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning](https://mlsanity.com/paper/2104.11056/) (2021)
- [Semi-Supervised Domain Adaptation with Source Label Adaptation](https://mlsanity.com/paper/2302.02335/) (2023)
- [Dual-Reference Source-Free Active Domain Adaptation for Nasopharyngeal Carcinoma Tumor Segmentation across Multiple Hospitals](https://mlsanity.com/paper/2309.13401/) (2023)
- [Semi-supervised Domain Adaptation via Sample-to-Sample Self-Distillation](https://mlsanity.com/paper/2111.14353/) (2021)
- [SPA: A Graph Spectral Alignment Perspective for Domain Adaptation](https://mlsanity.com/paper/2310.17594/) (2023)
- [Multi-level Consistency Learning for Semi-supervised Domain Adaptation](https://mlsanity.com/paper/2205.04066/) (2022)
- [ACT: Semi-supervised Domain-adaptive Medical Image Segmentation with Asymmetric Co-training](https://mlsanity.com/paper/2206.02288/) (2022)
- [Prior Knowledge Guided Unsupervised Domain Adaptation](https://mlsanity.com/paper/2207.08877/) (2022)
- [Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentation](https://mlsanity.com/paper/2308.14619/) (2023)
- [Surprisingly Simple Semi-Supervised Domain Adaptation with Pretraining and Consistency](https://mlsanity.com/paper/2101.12727/) (2021)
- [Learning CNN on ViT: A Hybrid Model to Explicitly Class-specific Boundaries for Domain Adaptation](https://mlsanity.com/paper/2403.18360/) (2024)
- [Active Source Free Domain Adaptation](https://mlsanity.com/paper/2205.10711/) (2022)
- [Bridged-GNN: Knowledge Bridge Learning for Effective Knowledge Transfer](https://mlsanity.com/paper/2308.09499/) (2023)
- [Inter-Domain Mixup for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2401.11453/) (2024)
- [Semi-supervised Domain Adaptation via Prototype-based Multi-level Learning](https://mlsanity.com/paper/2305.02693/) (2023)
- [Adaptive Betweenness Clustering for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2401.11448/) (2024)
- [Weak Adaptation Learning -- Addressing Cross-domain Data Insufficiency with Weak Annotator](https://mlsanity.com/paper/2102.07358/) (2021)
- [Gradual Domain Adaptation via Self-Training of Auxiliary Models](https://mlsanity.com/paper/2106.09890/) (2021)
- [Probabilistic Contrastive Learning for Domain Adaptation](https://mlsanity.com/paper/2111.06021/) (2021)
- [Learning Domain Invariant Representations by Joint Wasserstein Distance Minimization](https://mlsanity.com/paper/2106.04923/) (2021)
- [Semi-Supervised Hypothesis Transfer for Source-Free Domain Adaptation](https://mlsanity.com/paper/2107.06735/) (2021)
- [Principled Federated Domain Adaptation: Gradient Projection and Auto-Weighting](https://mlsanity.com/paper/2302.05049/) (2023)

## Abstract (arXiv)

Although unsupervised domain adaptation methods have been widely adopted across several computer vision tasks, it is more desirable if we can exploit a few labeled data from new domains encountered in a real application. The novel setting of the semi-supervised domain adaptation (SSDA) problem shares the challenges with the domain adaptation problem and the semi-supervised learning problem. However, a recent study shows that conventional domain adaptation and semi-supervised learning methods often result in less effective or negative transfer in the SSDA problem. In order to interpret the observation and address the SSDA problem, in this paper, we raise the intra-domain discrepancy issue within the target domain, which has never been discussed so far. Then, we demonstrate that addressing the intra-domain discrepancy leads to the ultimate goal of the SSDA problem. We propose an SSDA framework that aims to align features via alleviation of the intra-domain discrepancy. Our framework mainly consists of three schemes, i.e., attraction, perturbation, and exploration. First, the attraction scheme globally minimizes the intra-domain discrepancy within the target domain. Second, we demonstrate the incompatibility of the conventional adversarial perturbation methods with SSDA. Then, we present a domain adaptive adversarial perturbation scheme, which perturbs the given target samples in a way that reduces the intra-domain discrepancy. Finally, the exploration scheme locally aligns features in a class-wise manner complementary to the attraction scheme by selectively aligning unlabeled target features complementary to the perturbation scheme. We conduct extensive experiments on domain adaptation benchmark datasets such as DomainNet, Office-Home, and Office. Our method achieves state-of-the-art performances on all datasets.
