Entropic Projection Alignment: Estimating, Explaining, and Improving Model Performance Under Distribution Shift
Not on the map. Why?
Abstract (arXiv)
We propose a unified framework for addressing three key challenges of distribution shift: (1) estimating a model's performance on an unlabeled target domain, (2) explaining the shift by identifying the features responsible, and (3) improving the target domain performance. Our method, Entropic Projection Alignment (EPA), aligns the source distribution to the target by matching carefully selected moments while simultaneously minimising the KL divergence from the source. This formulation yields a unique closed-form solution for importance weights, achieving robustness through implicit variance control. Drawing on domain adaptation theory, we establish that moment matching is sufficient for reliable estimation and adaptation, avoiding the need for full density ratio recovery. Extensive experiments, together with strong theoretical guarantees, demonstrate that EPA consistently outperforms state-of-the-art baselines while offering substantial computational efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 41 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
18 of 41 references.
References · 18
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
- 2017Adversarial Discriminative Domain Adaptationcited by 1,311
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 449
- 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 366
- 2018What is the Effect of Importance Weighting in Deep Learning?cited by 251
- 2023Benchmarking Distribution Shift in Tabular Data with TableShiftcited by 66
6 more
- 2022Understanding Why Generalized Reweighting Does Not Improve Over ERMcited by 29
- 2022Estimating and Explaining Model Performance When Both Covariates and Labels Shiftcited by 19
- 2023When is Importance Weighting Correction Needed for Covariate Shift Adaptation?cited by 13
- 2023Sparse joint shift in multinomial classificationcited by 5
- 2023Invariance assumptions for class distribution estimationcited by 4
- 2023Domain Adaptation via Rebalanced Sub-domain Alignmentcited by 1
Built on by
Not cited yet.