Dual-Foundation Models for Unsupervised Domain Adaptation
Not on the map. Why?
Abstract (arXiv)
Semantic segmentation provides pixel-level scene understanding essential for autonomous driving and fine-grained perception tasks. However, training segmentation models requires costly, labor-intensive annotations on real-world datasets. Unsupervised Domain Adaptation (UDA) addresses this by training models on labeled synthetic data and adapting them to unlabeled real images. While conceptually simple, adaptation is challenging due to the domain gap, i.e., differences in visual appearance and scene structure between synthetic and real data. Prior approaches bridge this gap through pixel-level mixing or feature-level contrastive learning. Yet, these techniques suffer from two major limitations: (1) reliance on high-confidence pseudo-labels restricts learning to a subset of the target domain, and (2) prototype-based contrastive methods initialize class prototypes from source-trained models, yielding biased and unstable anchors during adaptation. To address these issues, we propose a dual-foundation UDA framework that leverages two complementary foundation models. First, we employ the Segment Anything Model (SAM) with superpixel-guided prompting to enable learning from a broader range of target pixels beyond high-confidence predictions. Second, we incorporate DINOv3 to construct stable, domain-invariant class prototypes through its robust representation learning. Our method achieves consistent improvements of +1.3% and +1.4% mIoU over strong UDA baselines on GTA-to-Cityscapes and SYNTHIA-to-Cityscapes, respectively.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 57 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
46 of 57 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2025DINOv3cited by 1,297
- 2017A Closer Look at Memorization in Deep Networkscited by 936
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
- 2020FDA: Fourier Domain Adaptation for Semantic Segmentationcited by 540
34 more
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 299
- 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2020DACS: Domain Adaptation via Cross-domain Mixed Samplingcited by 226
- 2018DLOW: Domain Flow for Adaptation and Generalizationcited by 176
- 2022MIC: Masked Image Consistency for Context-Enhanced Domain Adaptationcited by 176
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 163
- 2020Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentationcited by 153
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2020Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentationcited by 126
- 2020Unsupervised Domain Adaptation in Semantic Segmentation: a Reviewcited by 88
- 2021PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Trainingcited by 80
- 2013SEEDS: Superpixels Extracted via Energy-Driven Samplingcited by 75
- 2022PODA: Prompt-driven Zero-shot Domain Adaptationcited by 60
- 2020Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentationcited by 58
- 2020Domain Adaptive Semantic Segmentation Using Weak Labelscited by 56
- 2021MetaCorrection: Domain-aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentationcited by 43
- 2020Learning from Scale-Invariant Examples for Domain Adaptation in Semantic Segmentationcited by 41
- 2022Prototypical Contrast Adaptation for Domain Adaptive Semantic Segmentationcited by 40
- 2023Collaborating Foundation Models for Domain Generalized Semantic Segmentationcited by 33
- 2022Refign: Align and Refine for Adaptation of Semantic Segmentation to Adverse Conditionscited by 31
- 2024Unified Language-driven Zero-shot Domain Adaptationcited by 30
- 2023A Simple Recipe for Language-guided Domain Generalized Segmentationcited by 27
- 2022Divide to Adapt: Mitigating Confirmation Bias for Domain Adaptation of Black-Box Predictorscited by 19
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinementcited by 19
- 2023Unsupervised Domain Adaptation for Semantic Segmentation with Pseudo Label Self-Refinementcited by 16
- 2023SAM4UDASS: When SAM Meets Unsupervised Domain Adaptive Semantic Segmentation in Intelligent Vehiclescited by 12
- 2024Exploring the Benefits of Vision Foundation Models for Unsupervised Domain Adaptationcited by 11
- 2025CoPT: Unsupervised Domain Adaptive Segmentation using Domain-Agnostic Text Embeddingscited by 7
- 2024Efficient unsupervised domain adaptation via self-supervised vision transformer and synergistic cross-domain alignmentcited by 5
- 2025SRPL-SFDA: SAM-Guided Reliable Pseudo-Labels for Source-Free Domain Adaptation in Medical Image Segmentationcited by 3
- 2025LangDA: Building Context-Awareness via Language for Domain Adaptive Semantic Segmentationcited by 1
Built on by
Not cited yet.