A New PAC-Bayesian Perspective on Domain Adaptation
Not on the map. Why?
Abstract (arXiv)
We study the issue of PAC-Bayesian domain adaptation: We want to learn, from a source domain, a majority vote model dedicated to a target one. Our theoretical contribution brings a new perspective by deriving an upper-bound on the target risk where the distributions' divergence---expressed as a ratio---controls the trade-off between a source error measure and the target voters' disagreement. Our bound suggests that one has to focus on regions where the source data is informative.From this result, we derive a PAC-Bayesian generalization bound, and specialize it to linear classifiers. Then, we infer a learning algorithmand perform experiments on real data.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 4; 2023: 8; 2024: 7; 2025: 2; 2026: 1.
29 papers.
Sort:
By area:
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2021User-friendly introduction to PAC-Bayes boundscited by 234
- 2023Domain Watermark: Effective and Harmless Dataset Copyright Protection is Closed at Handcited by 52
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
- 2023Invariant Learning via Probability of Sufficient and Necessary Causescited by 22
- 2021Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learningcited by 21
- 2022The Two Dimensions of Worst-case Training and the Integrated Effect for Out-of-domain Generalizationcited by 21
- 2024Position: Understanding LLMs Requires More Than Statistical Generalizationcited by 20
- 2021Characterizing and Understanding the Generalization Error of Transfer Learning with Gibbs Algorithmcited by 14
- 2021Toward Learning Human-aligned Cross-domain Robust Models by Countering Misaligned Featurescited by 14
- 2022PAC-Bayesian Domain Adaptation Bounds for Multiclass Learnerscited by 13
- 2024Towards Robust Out-of-Distribution Generalization Bounds via Sharpnesscited by 10
17 more
- 2024On f-Divergence Principled Domain Adaptation: An Improved Frameworkcited by 6
- 2022PAC-Bayesian Lifelong Learning For Multi-Armed Banditscited by 4
- 2024Phase-driven Domain Generalizable Learning for Nonstationary Time Seriescited by 4
- 2023CASUAL: Conditional Support Alignment for Domain Adaptation with Label Shiftcited by 3
- 2023Out-Of-Domain Unlabeled Data Improves Generalizationcited by 3
- 2023Bayesian Transfer Learningcited by 3
- 2024Generalization Bounds for Causal Regression: Insights, Guarantees and Sensitivity Analysiscited by 3
- 2021On Label Shift in Domain Adaptation via Wasserstein Distancecited by 2
- 2022Connecting sufficient conditions for domain adaptation: source-guided uncertainty, relaxed divergences and discrepancy localizationcited by 2
- 2021On the inductive biases of deep domain adaptationcited by 1
- 2023Practicality of generalization guarantees for unsupervised domain adaptation with neural networkscited by 1
- 2024PAC-Bayesian Domain Adaptation Bounds for Multi-view learningcited by 1
- 2025ODD: Overlap-aware Estimation of Model Performance under Distribution Shiftcited by 1
- 2023Semi-supervised Semantic Segmentation via Boosting Uncertainty on Unlabeled Datacited by 0
- 2024IMPaCT GNN: Imposing invariance with Message Passing in Chronological split Temporal Graphscited by 0
- 2025Feature-Space Planes Searcher: A Universal Domain Adaptation Framework for Interpretability and Computational Efficiencycited by 0
- 2026TRACE: Theoretical Risk Attribution under Covariate-shift Effectscited by 0
- 2026TRACE: Theoretical Risk Attribution under Covariate-shift Effects11 Feb 2026
- 2025Feature-Space Planes Searcher: A Universal Domain Adaptation Framework for Interpretability and Computational Efficiency26 Aug 2025
- 2025ODD: Overlap-aware Estimation of Model Performance under Distribution Shift17 Jun 2025
- 2024IMPaCT GNN: Imposing invariance with Message Passing in Chronological split Temporal Graphs17 Nov 2024
- 2024Generalization Bounds for Causal Regression: Insights, Guarantees and Sensitivity Analysis15 May 2024
- 2024Position: Understanding LLMs Requires More Than Statistical Generalization3 May 2024
- 2024Towards Robust Out-of-Distribution Generalization Bounds via Sharpness11 Mar 2024
- 2024Phase-driven Domain Generalizable Learning for Nonstationary Time Series5 Feb 2024
- 2024On f-Divergence Principled Domain Adaptation: An Improved Framework2 Feb 2024
- 2024PAC-Bayesian Domain Adaptation Bounds for Multi-view learning2 Jan 2024
- 2023Bayesian Transfer Learning20 Dec 2023
- 2023Semi-supervised Semantic Segmentation via Boosting Uncertainty on Unlabeled Data30 Nov 2023
17 more
- 2023Domain Watermark: Effective and Harmless Dataset Copyright Protection is Closed at Hand9 Oct 2023
- 2023Out-Of-Domain Unlabeled Data Improves Generalization29 Sep 2023
- 2023Invariant Learning via Probability of Sufficient and Necessary Causes22 Sep 2023
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives31 Jul 2023
- 2023CASUAL: Conditional Support Alignment for Domain Adaptation with Label Shift29 May 2023
- 2023Practicality of generalization guarantees for unsupervised domain adaptation with neural networks15 Mar 2023
- 2022PAC-Bayesian Domain Adaptation Bounds for Multiclass Learners12 Jul 2022
- 2022The Two Dimensions of Worst-case Training and the Integrated Effect for Out-of-domain Generalization9 Apr 2022
- 2022Connecting sufficient conditions for domain adaptation: source-guided uncertainty, relaxed divergences and discrepancy localization9 Mar 2022
- 2022PAC-Bayesian Lifelong Learning For Multi-Armed Bandits7 Mar 2022
- 2021Toward Learning Human-aligned Cross-domain Robust Models by Countering Misaligned Features5 Nov 2021
- 2021Characterizing and Understanding the Generalization Error of Transfer Learning with Gibbs Algorithm2 Nov 2021
- 2021On Label Shift in Domain Adaptation via Wasserstein Distance29 Oct 2021
- 2021User-friendly introduction to PAC-Bayes bounds21 Oct 2021
- 2021On the inductive biases of deep domain adaptation16 Sep 2021
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization9 Jul 2021
- 2021Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning28 May 2021
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2021User-friendly introduction to PAC-Bayes boundscited by 234
- 2023Domain Watermark: Effective and Harmless Dataset Copyright Protection is Closed at Handcited by 52
- 2023Invariant Learning via Probability of Sufficient and Necessary Causescited by 22
- 2021Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learningcited by 21
- 2022The Two Dimensions of Worst-case Training and the Integrated Effect for Out-of-domain Generalizationcited by 21
- 2024Position: Understanding LLMs Requires More Than Statistical Generalizationcited by 20
- 2021Characterizing and Understanding the Generalization Error of Transfer Learning with Gibbs Algorithmcited by 14
- 2021Toward Learning Human-aligned Cross-domain Robust Models by Countering Misaligned Featurescited by 14
- 2022PAC-Bayesian Domain Adaptation Bounds for Multiclass Learnerscited by 13
- 2024Towards Robust Out-of-Distribution Generalization Bounds via Sharpnesscited by 10
- 2024On f-Divergence Principled Domain Adaptation: An Improved Frameworkcited by 6
12 most cited of 28 All 28 (JSON)
- 2026TRACE: Theoretical Risk Attribution under Covariate-shift Effects11 Feb 2026
- 2025Feature-Space Planes Searcher: A Universal Domain Adaptation Framework for Interpretability and Computational Efficiency26 Aug 2025
- 2025ODD: Overlap-aware Estimation of Model Performance under Distribution Shift17 Jun 2025
- 2024IMPaCT GNN: Imposing invariance with Message Passing in Chronological split Temporal Graphs17 Nov 2024
- 2024Generalization Bounds for Causal Regression: Insights, Guarantees and Sensitivity Analysis15 May 2024
- 2024Position: Understanding LLMs Requires More Than Statistical Generalization3 May 2024
- 2024Towards Robust Out-of-Distribution Generalization Bounds via Sharpness11 Mar 2024
- 2024Phase-driven Domain Generalizable Learning for Nonstationary Time Series5 Feb 2024
- 2024On f-Divergence Principled Domain Adaptation: An Improved Framework2 Feb 2024
- 2024PAC-Bayesian Domain Adaptation Bounds for Multi-view learning2 Jan 2024
- 2023Bayesian Transfer Learning20 Dec 2023
- 2023Semi-supervised Semantic Segmentation via Boosting Uncertainty on Unlabeled Data30 Nov 2023
12 newest of 28 All 28 (JSON)