LEAD: Learning Decomposition for Source-free Universal Domain Adaptation
Not on the map. Why?
Abstract (arXiv)
Universal Domain Adaptation (UniDA) targets knowledge transfer in the presence of both covariate and label shifts. Recently, Source-free Universal Domain Adaptation (SF-UniDA) has emerged to achieve UniDA without access to source data, which tends to be more practical due to data protection policies. The main challenge lies in determining whether covariate-shifted samples belong to target-private unknown categories. Existing methods tackle this either through hand-crafted thresholding or by developing time-consuming iterative clustering strategies. In this paper, we propose a new idea of LEArning Decomposition (LEAD), which decouples features into source-known and -unknown components to identify target-private data. Technically, LEAD initially leverages the orthogonal decomposition analysis for feature decomposition. Then, LEAD builds instance-level decision boundaries to adaptively identify target-private data. Extensive experiments across various UniDA scenarios have demonstrated the effectiveness and superiority of LEAD. Notably, in the OPDA scenario on VisDA dataset, LEAD outperforms GLC by 3.5% overall H-score and reduces 75% time to derive pseudo-labeling decision boundaries. Besides, LEAD is also appealing in that it is complementary to most existing methods. The code is available at https://github.com/ispc-lab/LEAD.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 48 of its 69 references that are in the map. First posted on arXiv 6 Mar 2024.
Builds on
48 of 69 references.
References · 48
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2023Segment Anythingcited by 8,158
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
36 more
- 2018Recognition in Terra Incognitacited by 655
- 2015Optimal Transport for Domain Adaptationcited by 457
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 442
- 2017VisDA: The Visual Domain Adaptation Challengecited by 432
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2019High Frequency Component Helps Explain the Generalization of Convolutional Neural Networkscited by 310
- 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
- 2020DACS: Domain Adaptation via Cross-domain Mixed Samplingcited by 226
- 2020Universal Source-Free Domain Adaptationcited by 219
- 2021Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptationcited by 176
- 2021Generalized Source-free Domain Adaptationcited by 175
- 2020Universal Domain Adaptation through Self Supervisioncited by 172
- 2019A review of domain adaptation without target labelscited by 154
- 2018Open Set Domain Adaptation by Backpropagationcited by 150
- 2019Progressive Domain Adaptation for Object Detectioncited by 134
- 2020Efficient Domain Generalization via Common-Specific Low-Rank Decompositioncited by 134
- 2020Learning to Balance Specificity and Invariance for In and Out of Domain Generalizationcited by 128
- 2017No More Discrimination: Cross City Adaptation of Road Scene Segmenterscited by 110
- 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
- 2021Semantically Coherent Out-of-Distribution Detectioncited by 107
- 2021OVANet: One-vs-All Network for Universal Domain Adaptationcited by 92
- 2019Learning to Transfer Examples for Partial Domain Adaptationcited by 86
- 2022Training OOD Detectors in their Natural Habitatscited by 86
- 2017Partial Transfer Learning with Selective Adversarial Networkscited by 84
- 2021VDM-DA: Virtual Domain Modeling for Source Data-free Domain Adaptationcited by 69
- 2018Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Losscited by 60
- 2022Unified Optimal Transport Framework for Universal Domain Adaptationcited by 57
- 2022Divide and Contrast: Source-free Domain Adaptation via Adaptive Contrastive Learningcited by 53
- 2022BMD: A General Class-balanced Multicentric Dynamic Prototype Strategy for Source-free Domain Adaptationcited by 39
- 2023Upcycling Models under Domain and Category Shiftcited by 29
- 2021UMAD: Universal Model Adaptation under Domain and Category Shiftcited by 23
- 2022Prior Knowledge Guided Unsupervised Domain Adaptationcited by 20
- 2023Modality-Agnostic Debiasing for Single Domain Generalizationcited by 14
- 2023DEJA VU: Continual Model Generalization For Unseen Domainscited by 13
- 2020Open-Set Hypothesis Transfer with Semantic Consistencycited by 11
- 2021Mining Data Impressions from Deep Models as Substitute for the Unavailable Training Datacited by 7
Built on by
Citing papers per year: 2024: 9; 2025: 11; 2026: 5.
25 papers.
Sort:
By area:
- 2024GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editingcited by 14
- 2024Multi-Granularity Class Prototype Topology Distillation for Class-Incremental Source-Free Unsupervised Domain Adaptationcited by 10
- 2026USBD: Universal Structural Basis Distillation for Source-Free Graph Domain Adaptationcited by 9
- 2024HGL: Hierarchical Geometry Learning for Test-time Adaptation in 3D Point Cloud Segmentationcited by 6
- 2024Recall and Refine: A Simple but Effective Source-free Open-set Domain Adaptation Frameworkcited by 6
- 2024MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protectioncited by 4
- 2024GLC++: Source-Free Universal Domain Adaptation through Global-Local Clustering and Contrastive Affinity Learningcited by 4
- 2024Memory-Efficient Pseudo-Labeling for Online Source-Free Universal Domain Adaptation using a Gaussian Mixture Modelcited by 4
- 2025Target Semantics Clustering via Text Representations for Robust Universal Domain Adaptationcited by 4
- 2025Exploring Probabilistic Modeling Beyond Domain Generalization for Semantic Segmentationcited by 3
- 2024Tackling Dimensional Collapse toward Comprehensive Universal Domain Adaptationcited by 1
- 2025Training-Free Label Space Alignment for Universal Domain Adaptationcited by 1
13 more
- 2024Domain-invariant Representation Learning via Segment Anything Model for Blood Cell Classificationcited by 0
- 2025Analysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptationcited by 0
- 2025Beyond Retraining: Training-Free Unknown Class Filtering for Source-Free Open Set Domain Adaptation of Vision-Language Modelscited by 0
- 2025From Entanglement to Alignment: Representation Space Decomposition for Unsupervised Time Series Domain Adaptationcited by 0
- 2025Frustratingly Easy Feature Reconstruction for Out-of-Distribution Detectioncited by 0
- 2025Cross-Domain Attribute Alignment with CLIP: A Rehearsal-Free Approach for Class-Incremental Unsupervised Domain Adaptationcited by 0
- 2025Vicinity-Guided Discriminative Latent Diffusion for Privacy-Preserving Domain Adaptationcited by 0
- 2025Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptationcited by 0
- 2025Autonomous Source Knowledge Selection in Multi-Domain Adaptationcited by 0
- 2026Safe-Subspace Pseudo-Label Refinement for Source-Free Graph Domain Adaptationcited by 0
- 2026LFM: Leveraging Foundation Models for Source-Free Universal Domain Adaptationcited by 0
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptationcited by 0
- 2026A Comprehensive Benchmark of Source-Free Universal Domain Adaptation on Time Series Representationscited by 0
- 2026A Comprehensive Benchmark of Source-Free Universal Domain Adaptation on Time Series Representations30 Sep 2026
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation20 Aug 2026
- 2026LFM: Leveraging Foundation Models for Source-Free Universal Domain Adaptation20 Jul 2026
- 2026Safe-Subspace Pseudo-Label Refinement for Source-Free Graph Domain Adaptation30 May 2026
- 2026USBD: Universal Structural Basis Distillation for Source-Free Graph Domain Adaptation9 Feb 2026
- 2025Autonomous Source Knowledge Selection in Multi-Domain Adaptation8 Dec 2025
- 2025Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptation24 Nov 2025
- 2025Vicinity-Guided Discriminative Latent Diffusion for Privacy-Preserving Domain Adaptation1 Oct 2025
- 2025Training-Free Label Space Alignment for Universal Domain Adaptation22 Sep 2025
- 2025Cross-Domain Attribute Alignment with CLIP: A Rehearsal-Free Approach for Class-Incremental Unsupervised Domain Adaptation14 Sep 2025
- 2025Frustratingly Easy Feature Reconstruction for Out-of-Distribution Detection2 Sep 2025
- 2025Exploring Probabilistic Modeling Beyond Domain Generalization for Semantic Segmentation28 Jul 2025
13 more
- 2025From Entanglement to Alignment: Representation Space Decomposition for Unsupervised Time Series Domain Adaptation28 Jul 2025
- 2025Target Semantics Clustering via Text Representations for Robust Universal Domain Adaptation4 Jun 2025
- 2025Beyond Retraining: Training-Free Unknown Class Filtering for Source-Free Open Set Domain Adaptation of Vision-Language Models19 Apr 2025
- 2025Analysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptation16 Apr 2025
- 2024GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing3 Dec 2024
- 2024Multi-Granularity Class Prototype Topology Distillation for Class-Incremental Source-Free Unsupervised Domain Adaptation25 Nov 2024
- 2024Recall and Refine: A Simple but Effective Source-free Open-set Domain Adaptation Framework19 Nov 2024
- 2024Tackling Dimensional Collapse toward Comprehensive Universal Domain Adaptation15 Oct 2024
- 2024Domain-invariant Representation Learning via Segment Anything Model for Blood Cell Classification14 Aug 2024
- 2024Memory-Efficient Pseudo-Labeling for Online Source-Free Universal Domain Adaptation using a Gaussian Mixture Model19 Jul 2024
- 2024HGL: Hierarchical Geometry Learning for Test-time Adaptation in 3D Point Cloud Segmentation17 Jul 2024
- 2024GLC++: Source-Free Universal Domain Adaptation through Global-Local Clustering and Contrastive Affinity Learning21 Mar 2024
- 2024MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protection7 Mar 2024
- 2024Multi-Granularity Class Prototype Topology Distillation for Class-Incremental Source-Free Unsupervised Domain Adaptationcited by 10
- 2026USBD: Universal Structural Basis Distillation for Source-Free Graph Domain Adaptationcited by 9
- 2024HGL: Hierarchical Geometry Learning for Test-time Adaptation in 3D Point Cloud Segmentationcited by 6
- 2024Recall and Refine: A Simple but Effective Source-free Open-set Domain Adaptation Frameworkcited by 6
- 2024MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protectioncited by 4
- 2024GLC++: Source-Free Universal Domain Adaptation through Global-Local Clustering and Contrastive Affinity Learningcited by 4
- 2024Memory-Efficient Pseudo-Labeling for Online Source-Free Universal Domain Adaptation using a Gaussian Mixture Modelcited by 4
- 2025Target Semantics Clustering via Text Representations for Robust Universal Domain Adaptationcited by 4
- 2024Tackling Dimensional Collapse toward Comprehensive Universal Domain Adaptationcited by 1
- 2024Domain-invariant Representation Learning via Segment Anything Model for Blood Cell Classificationcited by 0
- 2025Analysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptationcited by 0
- 2025From Entanglement to Alignment: Representation Space Decomposition for Unsupervised Time Series Domain Adaptationcited by 0
12 most cited of 20 All 20 (JSON)
- 2026A Comprehensive Benchmark of Source-Free Universal Domain Adaptation on Time Series Representations30 Sep 2026
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation20 Aug 2026
- 2026LFM: Leveraging Foundation Models for Source-Free Universal Domain Adaptation20 Jul 2026
- 2026Safe-Subspace Pseudo-Label Refinement for Source-Free Graph Domain Adaptation30 May 2026
- 2026USBD: Universal Structural Basis Distillation for Source-Free Graph Domain Adaptation9 Feb 2026
- 2025Autonomous Source Knowledge Selection in Multi-Domain Adaptation8 Dec 2025
- 2025Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptation24 Nov 2025
- 2025Cross-Domain Attribute Alignment with CLIP: A Rehearsal-Free Approach for Class-Incremental Unsupervised Domain Adaptation14 Sep 2025
- 2025Frustratingly Easy Feature Reconstruction for Out-of-Distribution Detection2 Sep 2025
- 2025From Entanglement to Alignment: Representation Space Decomposition for Unsupervised Time Series Domain Adaptation28 Jul 2025
- 2025Target Semantics Clustering via Text Representations for Robust Universal Domain Adaptation4 Jun 2025
- 2025Analysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptation16 Apr 2025
12 newest of 20 All 20 (JSON)