Algorithms and Theory for Multiple-Source Adaptation
Not on the map. Why?
Abstract (arXiv)
This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new guarantees that hold in the case where the conditional probabilities for the source domains are distinct. Moreover, we give new algorithms for determining the distribution-weighted combination solution for the cross-entropy loss and other losses. We report the results of a series of experiments with real-world datasets. We find that our algorithm outperforms competing approaches by producing a single robust model that performs well on any target mixture distribution. Altogether, our theory, algorithms, and empirical results provide a full solution for the multiple-source adaptation problem with very practical benefits.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 11; 2023: 12; 2024: 6; 2025: 2; 2026: 2.
53 papers.
Sort:
By area:
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2022Sparse Mixture-of-Experts are Domain Generalizable Learnerscited by 85
- 2021Unsupervised Multi-source Domain Adaptation Without Access to Source Datacited by 76
- 2021FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learningcited by 67
- 2022SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEGcited by 53
- 2021f-Domain-Adversarial Learning: Theory and Algorithmscited by 47
- 2021Online Adaptation to Label Distribution Shiftcited by 44
- 2021Your Classifier can Secretly Suffice Multi-Source Domain Adaptationcited by 42
- 2023Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learningcited by 39
- 2021Non-IID data and Continual Learning processes in Federated Learning: A long road aheadcited by 36
- 2022Multi-Source Unsupervised Domain Adaptation via Pseudo Target Domaincited by 27
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
38 more
- 2022Multi-Prompt Alignment for Multi-Source Unsupervised Domain Adaptationcited by 25
- 2021Aggregating From Multiple Target-Shifted Sourcescited by 24
- 2021T-SVDNet: Exploring High-Order Prototypical Correlations for Multi-Source Domain Adaptationcited by 24
- 2023Fairness and Accuracy under Domain Generalizationcited by 24
- 2021Multi-Source Domain Adaptation for Object Detectioncited by 21
- 2021Memory-aware curriculum federated learning for breast cancer classificationcited by 20
- 2021Unsupervised Domain Adaptation for Semantic Image Segmentation: a Comprehensive Surveycited by 19
- 2023Data Valuation and Detections in Federated Learningcited by 17
- 2022On Balancing Bias and Variance in Unsupervised Multi-Source-Free Domain Adaptationcited by 16
- 2021Information-theoretic regularization for Multi-source Domain Adaptationcited by 15
- 2021On Learning Domain-Invariant Representations for Transfer Learning with Multiple Sourcescited by 15
- 2021Transferrable Contrastive Learning for Visual Domain Adaptationcited by 14
- 2022Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detectioncited by 14
- 2024LanDA: Language-Guided Multi-Source Domain Adaptationcited by 13
- 2024SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEGcited by 12
- 2024More is Better: Deep Domain Adaptation with Multiple Sourcescited by 9
- 2021KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Taskscited by 8
- 2021Graphical Modeling for Multi-Source Domain Adaptationcited by 7
- 2021Multi-source Few-shot Domain Adaptationcited by 7
- 2023Best-Effort Adaptationcited by 7
- 2021Domain Consistency Regularization for Unsupervised Multi-source Domain Adaptive Classificationcited by 6
- 2024What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions?cited by 6
- 2023Prominent Roles of Conditionally Invariant Components in Domain Adaptation: Theory and Algorithmscited by 5
- 2023UFDA: Universal Federated Domain Adaptation with Practical Assumptionscited by 5
- 2024Domain adaptation in small-scale and heterogeneous biological datasetscited by 5
- 2022Algorithms and Theory for Supervised Gradual Domain Adaptationcited by 4
- 2022(Im)possibility of Collective Intelligencecited by 4
- 2022Regularization Penalty Optimization for Addressing Data Quality Variance in OoD Algorithmscited by 4
- 2022Gated Domain Units for Multi-source Domain Generalizationcited by 4
- 2026A Theoretical Framework for Modular Learning of Robust Generative Modelscited by 4
- 2021Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learningcited by 3
- 2022Union-set Multi-source Model Adaptation for Semantic Segmentationcited by 3
- 2023MMRDN: Consistent Representation for Multi-View Manipulation Relationship Detection in Object-Stacked Scenescited by 1
- 2023FREEDOM: Target Label & Source Data & Domain Information-Free Multi-Source Domain Adaptation for Unsupervised Personalizationcited by 1
- 2025On the Hardness of Unsupervised Domain Adaptation: Optimal Learners and Information-Theoretic Perspectivecited by 1
- 2023Local Boosting for Weakly-Supervised Learningcited by 0
- 2023Continual Invariant Risk Minimizationcited by 0
- 2023Weighted Joint Maximum Mean Discrepancy Enabled Multi-Source-Multi-Target Unsupervised Domain Adaptation Fault Diagnosiscited by 0
50 most cited of 53 All 53 (JSON)
- 2026A Theoretical Framework for Modular Learning of Robust Generative Models19 Feb 2026
- 20263D-Agent:Tri-Modal Multi-Agent Collaboration for Scalable 3D Object Annotation7 Jan 2026
- 2025Semi-Supervised Deep Domain Adaptation for Predicting Solar Power Across Different Locations6 Aug 2025
- 2025On the Hardness of Unsupervised Domain Adaptation: Optimal Learners and Information-Theoretic Perspective9 Jul 2025
- 2024SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEG26 Oct 2024
- 2024What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions?14 Jun 2024
- 2024Domain adaptation in small-scale and heterogeneous biological datasets29 May 2024
- 2024More is Better: Deep Domain Adaptation with Multiple Sources1 May 2024
- 2024Leveraging Synthetic Data for Generalizable and Fair Facial Action Unit Detection15 Mar 2024
- 2024LanDA: Language-Guided Multi-Source Domain Adaptation25 Jan 2024
- 2023UFDA: Universal Federated Domain Adaptation with Practical Assumptions27 Nov 2023
- 2023Data Valuation and Detections in Federated Learning9 Nov 2023
38 more
- 2023Continual Invariant Risk Minimization21 Oct 2023
- 2023Weighted Joint Maximum Mean Discrepancy Enabled Multi-Source-Multi-Target Unsupervised Domain Adaptation Fault Diagnosis20 Oct 2023
- 2023Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learning28 Sep 2023
- 2023Prominent Roles of Conditionally Invariant Components in Domain Adaptation: Theory and Algorithms19 Sep 2023
- 2023FREEDOM: Target Label & Source Data & Domain Information-Free Multi-Source Domain Adaptation for Unsupervised Personalization4 Jul 2023
- 2023Local Boosting for Weakly-Supervised Learning5 Jun 2023
- 2023Best-Effort Adaptation10 May 2023
- 2023MMRDN: Consistent Representation for Multi-View Manipulation Relationship Detection in Object-Stacked Scenes25 Apr 2023
- 2023Semantic Image Segmentation: Two Decades of Research13 Feb 2023
- 2023Fairness and Accuracy under Domain Generalization30 Jan 2023
- 2022Union-set Multi-source Model Adaptation for Semantic Segmentation6 Dec 2022
- 2022Multi-Prompt Alignment for Multi-Source Unsupervised Domain Adaptation30 Sep 2022
- 2022Gated Domain Units for Multi-source Domain Generalization24 Jun 2022
- 2022Regularization Penalty Optimization for Addressing Data Quality Variance in OoD Algorithms12 Jun 2022
- 2022Sparse Mixture-of-Experts are Domain Generalizable Learners8 Jun 2022
- 2022(Im)possibility of Collective Intelligence5 Jun 2022
- 2022SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEG2 Jun 2022
- 2022Algorithms and Theory for Supervised Gradual Domain Adaptation25 Apr 2022
- 2022Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detection17 Apr 2022
- 2022Multi-Source Unsupervised Domain Adaptation via Pseudo Target Domain22 Feb 2022
- 2022On Balancing Bias and Variance in Unsupervised Multi-Source-Free Domain Adaptation1 Feb 2022
- 2021Transferrable Contrastive Learning for Visual Domain Adaptation14 Dec 2021
- 2021Unsupervised Domain Adaptation for Semantic Image Segmentation: a Comprehensive Survey6 Dec 2021
- 2021Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learning6 Dec 2021
- 2021On Learning Domain-Invariant Representations for Transfer Learning with Multiple Sources27 Nov 2021
- 2021Non-IID data and Continual Learning processes in Federated Learning: A long road ahead26 Nov 2021
- 2021KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks6 Oct 2021
- 2021Multi-source Few-shot Domain Adaptation25 Sep 2021
- 2021T-SVDNet: Exploring High-Order Prototypical Correlations for Multi-Source Domain Adaptation30 Jul 2021
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization9 Jul 2021
- 2021Online Adaptation to Label Distribution Shift9 Jul 2021
- 2021Memory-aware curriculum federated learning for breast cancer classification6 Jul 2021
- 2021Multi-Source Domain Adaptation for Object Detection30 Jun 2021
- 2021f-Domain-Adversarial Learning: Theory and Algorithms21 Jun 2021
- 2021Domain Consistency Regularization for Unsupervised Multi-source Domain Adaptive Classification16 Jun 2021
- 2021Aggregating From Multiple Target-Shifted Sources9 May 2021
- 2021Graphical Modeling for Multi-Source Domain Adaptation27 Apr 2021
- 2021Unsupervised Multi-source Domain Adaptation Without Access to Source Data5 Apr 2021
50 newest of 53 All 53 (JSON)
- 2022Sparse Mixture-of-Experts are Domain Generalizable Learnerscited by 85
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2021Unsupervised Multi-source Domain Adaptation Without Access to Source Datacited by 76
- 2021FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learningcited by 67
- 2022SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEGcited by 53
- 2021f-Domain-Adversarial Learning: Theory and Algorithmscited by 47
- 2021Online Adaptation to Label Distribution Shiftcited by 44
- 2021Your Classifier can Secretly Suffice Multi-Source Domain Adaptationcited by 42
- 2023Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learningcited by 39
- 2021Non-IID data and Continual Learning processes in Federated Learning: A long road aheadcited by 36
- 2022Multi-Source Unsupervised Domain Adaptation via Pseudo Target Domaincited by 27
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2022Multi-Prompt Alignment for Multi-Source Unsupervised Domain Adaptationcited by 25
12 most cited of 51 All 51 (JSON)
- 2026A Theoretical Framework for Modular Learning of Robust Generative Models19 Feb 2026
- 2025Semi-Supervised Deep Domain Adaptation for Predicting Solar Power Across Different Locations6 Aug 2025
- 2025On the Hardness of Unsupervised Domain Adaptation: Optimal Learners and Information-Theoretic Perspective9 Jul 2025
- 2024SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEG26 Oct 2024
- 2024What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions?14 Jun 2024
- 2024Domain adaptation in small-scale and heterogeneous biological datasets29 May 2024
- 2024More is Better: Deep Domain Adaptation with Multiple Sources1 May 2024
- 2024Leveraging Synthetic Data for Generalizable and Fair Facial Action Unit Detection15 Mar 2024
- 2024LanDA: Language-Guided Multi-Source Domain Adaptation25 Jan 2024
- 2023UFDA: Universal Federated Domain Adaptation with Practical Assumptions27 Nov 2023
- 2023Data Valuation and Detections in Federated Learning9 Nov 2023
- 2023Continual Invariant Risk Minimization21 Oct 2023
12 newest of 51 All 51 (JSON)