mlsanityData to 7 Oct 2026

A new similarity measure for covariate shift with applications to nonparametric regression

arXiv 2202.02837 ↗First posted 6 Feb 2022math.ST cs.LG stat.MLcited by 33

Not on the map. Why?

Abstract (arXiv)

We study covariate shift in the context of nonparametric regression. We introduce a new measure of distribution mismatch between the source and target distributions that is based on the integrated ratio of probabilities of balls at a given radius. We use the scaling of this measure with respect to the radius to characterize the minimax rate of estimation over a family of H"older continuous functions under covariate shift. In comparison to the recently proposed notion of transfer exponent, this measure leads to a sharper rate of convergence and is more fine-grained. We accompany our theory with concrete instances of covariate shift that illustrate this sharp difference.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 3 of its 31 references that are in the map. First posted on arXiv 6 Feb 2022.

Builds on

3 of 31 references.

References · 3

  1. 2018Marginal Singularity, and the Benefits of Labels in Covariate-Shiftcited by 65
  2. 2021Near-Optimal Linear Regression under Distribution Shiftcited by 40
  3. 2020Minimax Lower Bounds for Transfer Learning with Linear and One-hidden Layer Neural Networkscited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 10; 2024: 12; 2025: 5; 2026: 2.

33 papers.

Sort:

  1. 2022Optimally tackling covariate shift in RKHS-based nonparametric regressioncited by 53
  2. 2022Adaptive and Robust Multi-Task Learningcited by 33
  3. 2022The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shiftcited by 25
  4. 2022Transfer Learning for Contextual Multi-armed Banditscited by 24
  5. 2024A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Modelscited by 20
  6. 2023Pseudo-Labeling for Kernel Ridge Regression under Covariate Shiftcited by 17
  7. 2023Maximum Likelihood Estimation is All You Need for Well-Specified Covariate Shiftcited by 14
  8. 2023Towards a Unified Analysis of Kernel-based Methods Under Covariate Shiftcited by 12
  9. 2023When is Importance Weighting Correction Needed for Covariate Shift Adaptation?cited by 11
  10. 2024Transfer Learning Beyond Bounded Density Ratioscited by 6
  11. 2024Mitigating Covariate Shift in Misspecified Regression with Applications to Reinforcement Learningcited by 4
  12. 2025Computational Efficiency under Covariate Shift in Kernel Ridge Regressioncited by 4
21 more
  1. 2023Classification Tree Pruning Under Covariate Shiftcited by 3
  2. 2023Transfer Learning for Kernel-based Regressioncited by 3
  3. 2023Double Debiased Covariate Shift Adaptation Robust to Density-Ratio Estimationcited by 3
  4. 2024On the design-dependent suboptimality of the Lassocited by 3
  5. 2024Sharp analysis of out-of-distribution error for "importance-weighted" estimators in the overparameterized regimecited by 3
  6. 2024Distributionally robust risk evaluation with an isotonic constraintcited by 3
  7. 2024Help Me Help You: The Aggregate Value of Source and Target Data in Transfer Learningcited by 3
  8. 2023Out of the Ordinary: Spectrally Adapting Regression for Covariate Shiftcited by 2
  9. 2024Bridging Domains with Approximately Shared Featurescited by 2
  10. 2024Trans-Glasso: A Transfer Learning Approach to Precision Matrix Estimationcited by 2
  11. 2023Statistical Learning under Heterogeneous Distribution Shiftcited by 1
  12. 2024Harnessing the Power of Vicinity-Informed Analysis for Classification under Covariate Shiftcited by 1
  13. 2023Covariate shift in nonparametric regression with Markovian designcited by 0
  14. 2024ADs: Active Data-sharing for Data Quality Assurance in Advanced Manufacturing Systemscited by 0
  15. 2024Prediction Accuracy & Reliability: Classification and Object Localization under Distribution Shiftcited by 0
  16. 2025Transfer Learning of Surrogate Models: Integrating Domain Warping and Affine Transformationscited by 0
  17. 2025Locally Private Nonparametric Contextual Multi-armed Banditscited by 0
  18. 2025Vector preference-based contextual bandits under distributional shiftscited by 0
  19. 2025A Conditional Distribution Equality Testing Framework using Deep Generative Learningcited by 0
  20. 2026Provable Target Sample Complexity Improvements as Pre-Trained Models Scalecited by 0
  21. 2026TILT: Target-induced loss tilting under covariate shiftcited by 0