# Multi-level Consistency Learning for Semi-supervised Domain Adaptation

arXiv: https://arxiv.org/abs/2205.04066 · HTML: https://mlsanity.com/paper/2205.04066/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 29 references that are in the map.
- First posted on arXiv 9 May 2022.

## Builds on (most cited first, 20 of 20)

- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Domain-Adversarial Training of Neural Networks](https://mlsanity.com/paper/1505.07818/) (2015)
- [Supervised Contrastive Learning](https://mlsanity.com/paper/2004.11362/) (2020)
- [RandAugment: Practical automated data augmentation with a reduced search space](https://mlsanity.com/paper/1909.13719/) (2019)
- [FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence](https://mlsanity.com/paper/2001.07685/) (2020)
- [Moment Matching for Multi-Source Domain Adaptation](https://mlsanity.com/paper/1812.01754/) (2018)
- [Deep Hashing Network for Unsupervised Domain Adaptation](https://mlsanity.com/paper/1706.07522/) (2017)
- [Unsupervised Data Augmentation for Consistency Training](https://mlsanity.com/paper/1904.12848/) (2019)
- [Optimal Transport for Domain Adaptation](https://mlsanity.com/paper/1507.00504/) (2015)
- [VisDA: The Visual Domain Adaptation Challenge](https://mlsanity.com/paper/1710.06924/) (2017)
- [Semi-supervised Domain Adaptation via Minimax Entropy](https://mlsanity.com/paper/1904.06487/) (2019)
- [Unbalanced minibatch Optimal Transport; applications to Domain Adaptation](https://mlsanity.com/paper/2103.03606/) (2021)
- [Domain Adaptation with Auxiliary Target Domain-Oriented Classifier](https://mlsanity.com/paper/2007.04171/) (2020)
- [Attract, Perturb, and Explore: Learning a Feature Alignment Network for Semi-supervised Domain Adaptation](https://mlsanity.com/paper/2007.09375/) (2020)
- [Cross-Domain Adaptive Clustering for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2104.09415/) (2021)
- [Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2004.04398/) (2020)
- [CLDA: Contrastive Learning for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2107.00085/) (2021)
- [Enhancing Pseudo Label Quality for Semi-Supervised Domain-Generalized Medical Image Segmentation](https://mlsanity.com/paper/2201.08657/) (2022)
- [Deep Co-Training with Task Decomposition for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2007.12684/) (2020)
- [ECACL: A Holistic Framework for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2104.09136/) (2021)

## Built on by (most cited first, 20 of 20)

- [Semi-supervised Domain Adaptation in Graph Transfer Learning](https://mlsanity.com/paper/2309.10773/) (2023)
- [Semi-Supervised Domain Adaptation with Source Label Adaptation](https://mlsanity.com/paper/2302.02335/) (2023)
- [Divide and Adapt: Active Domain Adaptation via Customized Learning](https://mlsanity.com/paper/2307.11618/) (2023)
- [ALEX: Towards Effective Graph Transfer Learning with Noisy Labels](https://mlsanity.com/paper/2309.14673/) (2023)
- [Semi-supervised Domain Adaptation via Prototype-based Multi-level Learning](https://mlsanity.com/paper/2305.02693/) (2023)
- [Adaptive Betweenness Clustering for Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2401.11448/) (2024)
- [Universal Semi-Supervised Domain Adaptation by Mitigating Common-Class Bias](https://mlsanity.com/paper/2403.11234/) (2024)
- [Is user feedback always informative? Retrieval Latent Defending for Semi-Supervised Domain Adaptation without Source Data](https://mlsanity.com/paper/2407.15383/) (2024)
- [Learning from Different Samples: A Source-free Framework for Semi-supervised Domain Adaptation](https://mlsanity.com/paper/2411.06665/) (2024)
- [Multi-Domain Learning From Insufficient Annotations](https://mlsanity.com/paper/2305.02757/) (2023)
- [Universal Semi-supervised Model Adaptation via Collaborative Consistency Training](https://mlsanity.com/paper/2307.03449/) (2023)
- [Unleashing the Power of Intermediate Domains for Mixed Domain Semi-Supervised Medical Image Segmentation](https://mlsanity.com/paper/2505.24567/) (2025)
- [Pick up the PACE: Fast and Simple Domain Adaptation via Ensemble Pseudo-Labeling](https://mlsanity.com/paper/2205.13508/) (2022)
- [SIDE: Self-supervised Intermediate Domain Exploration for Source-free Domain Adaptation](https://mlsanity.com/paper/2310.08928/) (2023)
- [Semi Supervised Heterogeneous Domain Adaptation via Disentanglement and Pseudo-Labelling](https://mlsanity.com/paper/2406.14087/) (2024)
- [AGLP: A Graph Learning Perspective for Semi-supervised Domain Adaptation](https://mlsanity.com/paper/2411.13152/) (2024)
- [Source-free Semantic Regularization Learning for Semi-supervised Domain Adaptation](https://mlsanity.com/paper/2501.01126/) (2025)
- [Domain Adaptive Object Detection for Space Applications with Real-Time Constraints](https://mlsanity.com/paper/2509.17593/) (2025)
- [PHASE: Physiology-Aware Hyperspectral Reconstruction via Object-to-Human Domain Adaptation](https://mlsanity.com/paper/2511.13020/) (2025)
- [A Multi-View Consistency Framework with Semi-Supervised Domain Adaptation](https://mlsanity.com/paper/2601.19266/) (2026)

## Abstract (arXiv)

Semi-supervised domain adaptation (SSDA) aims to apply knowledge learned from a fully labeled source domain to a scarcely labeled target domain. In this paper, we propose a Multi-level Consistency Learning (MCL) framework for SSDA. Specifically, our MCL regularizes the consistency of different views of target domain samples at three levels: (i) at inter-domain level, we robustly and accurately align the source and target domains using a prototype-based optimal transport method that utilizes the pros and cons of different views of target samples; (ii) at intra-domain level, we facilitate the learning of both discriminative and compact target feature representations by proposing a novel class-wise contrastive clustering loss; (iii) at sample level, we follow standard practice and improve the prediction accuracy by conducting a consistency-based self-training. Empirically, we verified the effectiveness of our MCL framework on three popular SSDA benchmarks, i.e., VisDA2017, DomainNet, and Office-Home datasets, and the experimental results demonstrate that our MCL framework achieves the state-of-the-art performance.
