mlsanityData to 14 Oct 2026

Sharp training-conditional coverage for conformal prediction under covariate shift

arXiv 2609.33456 ↗First posted 27 Sep 2026stat.ML cs.LG math.STcited by 1

Not on the map. Why?

Abstract (arXiv)

Weighted split conformal prediction reweights calibration scores by the likelihood ratio between the test and training covariate distributions and guarantees marginal coverage under covariate shift. We study its coverage conditional on the calibration data. An elementary argument, based on a single concentration inequality at a fixed population quantile, gives explicit training-conditional bounds without unspecified constants, and shows that the relevant scale is not the supremum of the likelihood ratio but a variance proxy built from the chi-squared divergence of the shift and from the average of the ratio over the part of the test population, of probability equal to the miscoverage level, where it is largest. A two-point lower bound shows that the root-m rate and the chi-squared contribution are intrinsic to the shift. Run at an explicitly inflated level, the weighted quantile becomes a deterministic PAC prediction set. We compare it with randomized rejection sampling and with importance-weighted learn-then-test and, through a certified choice of a clipping level for the likelihood ratio, map the regime in which each gives the narrower valid set. The analysis extends to estimated likelihood ratios and to tail functionals estimated from an unlabeled source sample, which yields a fully finite-sample certificate.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

13 of 27 references.

References · 13

  1. 2019Conformal Prediction Under Covariate Shiftcited by 519
  2. 2022Conformal prediction beyond exchangeabilitycited by 355
  3. 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
  4. 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 271
  5. 2020Estimating means of bounded random variables by bettingcited by 169
  6. 2020Conformal Inference of Counterfactuals and Individual Treatment Effectscited by 151
  7. 2022Conformal Prediction Under Feedback Covariate Shift for Biomolecular Designcited by 54
  8. 2021PAC Prediction Sets Under Covariate Shiftcited by 45
  9. 2022Doubly Robust Calibration of Prediction Sets under Covariate Shiftcited by 40
  10. 2022Prediction Sets Adaptive to Unknown Covariate Shiftcited by 22
  11. 2022JAWS: Auditing Predictive Uncertainty Under Covariate Shiftcited by 14
  12. 2024Training-Conditional Coverage Bounds under Covariate Shiftcited by 8
1 more
  1. 2026Weight Clipping for Robust Conformal Inference under Unbounded Covariate Shiftscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.