Conformal Prediction Under Covariate Shift
Not on the map. Why?
Abstract (arXiv)
We extend conformal prediction methodology beyond the case of exchangeable data. In particular, we show that a weighted version of conformal prediction can be used to compute distribution-free prediction intervals for problems in which the test and training covariate distributions differ, but the likelihood ratio between these two distributions is known---or, in practice, can be estimated accurately with access to a large set of unlabeled data (test covariate points). Our weighted extension of conformal prediction also applies more generally, to settings in which the data satisfies a certain weighted notion of exchangeability. We discuss other potential applications of our new conformal methodology, including latent variable and missing data problems.
Key facts. Cited by 511 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 46; 2023: 72; 2024: 91; 2025: 112; 2026: 171.
511 papers.
Sort:
By area:
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 360
- 2022Conformal Risk Controlcited by 290
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
- 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 256
- 2023Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hackingcited by 195
- 2022Adaptive Conformal Predictions for Time Seriescited by 155
- 2024Language Models with Conformal Factuality Guaranteescited by 128
- 2022Conformal Inference for Online Prediction with Arbitrary Distribution Shiftscited by 123
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 99
- 2023Conformal PID Control for Time Series Predictioncited by 85
- 2023Improved Online Conformal Prediction via Strongly Adaptive Online Learningcited by 76
38 more
- 2022Selection by Prediction with Conformal p-valuescited by 66
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
- 2022Training Uncertainty-Aware Classifiers with Conformalized Deep Learningcited by 62
- 2021Few-shot Conformal Prediction with Auxiliary Taskscited by 53
- 2021Conformalized Survival Analysiscited by 53
- 2022Conformal Prediction Under Feedback Covariate Shift for Biomolecular Designcited by 53
- 2023Conformal Prediction for Deep Classifier via Label Rankingcited by 52
- 2024Conformal Prediction for Natural Language Processing: A Surveycited by 52
- 2021Online Multivalid Learning: Means, Moments, and Prediction Intervalscited by 48
- 2022Probabilistic Conformal Prediction Using Conditional Random Samplescited by 47
- 2021PAC Prediction Sets Under Covariate Shiftcited by 42
- 2021Sample-Efficient Safety Assurances using Conformal Predictioncited by 41
- 2023Conformal Prediction for Time Series with Modern Hopfield Networkscited by 40
- 2022Robust Calibration with Multi-domain Temperature Scalingcited by 39
- 2024Length Optimization in Conformal Predictioncited by 39
- 2021Tracking the risk of a deployed model and detecting harmful distribution shiftscited by 38
- 2022Achieving Risk Control in Online Learning Settingscited by 38
- 2024Conformal prediction for multi-dimensional time series by ellipsoidal setscited by 37
- 2022On the Utility of Prediction Sets in Human-AI Teamscited by 34
- 2022Predictive Inference with Feature Conformal Predictioncited by 33
- 2023Conformal Prediction Regions for Time Series using Linear Complementarity Programmingcited by 33
- 2023Conformal prediction under ambiguous ground truthcited by 31
- 2022Calibrated Selective Classificationcited by 30
- 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospectscited by 30
- 2023Conformal Prediction for Federated Uncertainty Quantification Under Label Shiftcited by 29
- 2023Non-Exchangeable Conformal Risk Controlcited by 29
- 2022Bayesian Optimization with Conformal Prediction Setscited by 27
- 2023Designing Decision Support Systems Using Counterfactual Prediction Setscited by 26
- 2024Conformal Validity Guarantees Exist for Any Data Distribution (and How to Find Them)cited by 26
- 2022Conformal Prediction with Temporal Quantile Adjustmentscited by 25
- 2022Conformal Off-Policy Prediction in Contextual Banditscited by 25
- 2023Probabilistically robust conformal predictioncited by 25
- 2024Conformal Prediction: A Data Perspectivecited by 25
- 2023Adaptive conformal classification with noisy labelscited by 24
- 2023Conformal Meta-learners for Predictive Inference of Individual Treatment Effectscited by 23
- 2024Conformal Prediction with Learned Featurescited by 23
- 2022Prediction Sets Adaptive to Unknown Covariate Shiftcited by 22
- 2024Non-Exchangeable Conformal Language Generation with Nearest Neighborscited by 21
50 most cited of 511 All 511 (JSON)
- 2026Range-GRPO: Policy Optimization via Pairwise Relations among Reward Intervals1 Oct 2026
- 2026SimplexUQ: An Evaluation Framework and Benchmark for Conformal Uncertainty on Simplex-Valued Predictions30 Sep 2026
- 2026Adaptive Safety Filtering for Frozen ACC Policies via Conformal Residual Calibration28 Sep 2026
- 2026Risk-Controlled Selective LLM Answering by Pricing Label-Free Checks27 Sep 2026
- 2026RSD-Poker: Structure-Adaptive and Shift-Robust Risk-Utility Certification for Residual Policies in Imperfect-Information Games27 Sep 2026
- 2026Sharp training-conditional coverage for conformal prediction under covariate shift27 Sep 2026
- 2026RAEGL: Risk-Aware Evidence-Gated Learning for Selective Contextual Routing under Temporal Shift27 Sep 2026
- 2026When Can Old Evaluations Certify a New Model? Label-Efficient Release Decisions under Evaluator Drift26 Sep 2026
- 2026Trust Guided Decision Transformer25 Sep 2026
- 2026Multivariate conformal uncertainty propagation in multitask atomistic simulation: Successes and pitfalls25 Sep 2026
- 2026Conformal Prediction under Exponential-Tilt Joint Shift25 Sep 2026
- 2026Missingness-Aware Conformal Prediction Under Cross-Hospital Distribution Shift25 Sep 2026
38 more
- 2026Transfer Learning with Conformalized Quantile Regression for Solar PV Forecasting Under Load-Shedding-Driven Data Scarcity22 Sep 2026
- 2026PICPIs: Prediction-Interval-Conditional Prediction Intervals21 Sep 2026
- 2026Available Guardrails: Certifying Selective Prediction across ML Systems18 Sep 2026
- 2026ENCP: Episode-Normalized Conformal Prediction for Vision-and-Language Navigation15 Sep 2026
- 2026Conformal Individual Treatment Effect Estimation under Networked Interference14 Sep 2026
- 2026From matrix inversion to constraints: provably tighter confidence regions for importance weights in label shift13 Sep 2026
- 2026Multi-source conformal prediction: leveraging heterogeneity via localization13 Sep 2026
- 2026Split Conformal Prediction with Label-Shift-Adjusted Bayesian Scores11 Sep 2026
- 2026CHOIR: heterogeneity-aware conformal prediction for crash injury severity across driver safety strata10 Sep 2026
- 2026Improving the Sensitivity of Gravitational Wave Detection with Weighted Conformal Prediction10 Sep 2026
- 2026Conformal Calibration Transfer9 Sep 2026
- 2026Learning to Adapt and Calibrate: Score Distribution Alignment for Few-Shot Uncertainty Prediction in Medical VLMs9 Sep 2026
- 2026No Free Checker: A Survey of Verifiers for Robot Policies8 Sep 2026
- 2026Confounding-Valid Conformal Inference for Counterfactual KPIs in Wireless Networks4 Sep 2026
- 2026Conformity Breaks Conformal Prediction3 Sep 2026
- 2026Safety Screening for Voltage Control in Active Distribution Grids via Distributionally Robust Conformal Screening31 Aug 2026
- 2026A Unified Perspective on Conformal Prediction and Wasserstein Distributionally Robust Optimization for Uncertainty Quantification30 Aug 2026
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026TRACE-CRC: Trajectory-Adaptive Conformal Risk Control for Multi-Step Channel State Information Prediction27 Aug 2026
- 2026Conformal Bayes under Continuous Label Shift: Sensitivity Analysis and the Limits of Exact Validity24 Aug 2026
- 2026CS-WCP: Robust Conformal Sets for LLM-Judge Traffic Shifts with Uncertain Group Proportions23 Aug 2026
- 2026Reaching the Tail: Calibration Diversity Drives Conformal Coverage under Data Scarcity21 Aug 2026
- 2026The Exceedance Design Effect: Effective Sample Size for Thresholds under Clustering21 Aug 2026
- 2026Prediction certification cannot replace explanation certification: a competence envelope for trustworthy AI under compound stress21 Aug 2026
- 2026Does Marginal Coverage Guarantee Class-Conditional Safety for Zero-Shot VLMs Under Shift?19 Aug 2026
- 2026Bound-Aware Per-Organ Recall Risk Control for Multi-Organ CT Segmentation under Clinical Domain Shift18 Aug 2026
- 2026Conformal Prediction for Molecular Properties under Label Shift18 Aug 2026
- 2026SPACE: Sample-cloud Predictive Adaptive Conformal Ellipsoids for Multivariate Time-Series Forecasting18 Aug 2026
- 2026Temporal Graph Prototype-conditioned Conformal Prediction for Fraud Detection16 Aug 2026
- 2026Conditional Validity for Adaptive Modality Acquisition: When the Policy Chooses Its Own Calibration Group16 Aug 2026
- 2026Generalized Hierarchical Conformal Prediction16 Aug 2026
- 2026Retrieval-Corrected Conformal Prediction for Time Series11 Aug 2026
- 2026Conformal Calibration for Multi-Modal Regression with Missing Modalities7 Aug 2026
- 2026CoCoNav: Conformal Control for Safe Robot Navigation in Crowds7 Aug 2026
- 2026Conformal Coverage Guarantees for Any Video Temporal Grounder7 Aug 2026
- 2026Conformal Fusion Under Missing Modalities7 Aug 2026
- 2026SCP-NL2TL: Selective Conformal Prediction with Semantic Verification for Natural Language to Temporal Logic Specifications5 Aug 2026
- 2026CorePath: A Breast-Specialized Pathology Foundation Model for Core Needle Biopsy Diagnosis and Risk-Controlled Report Generation4 Aug 2026
50 newest of 511 All 511 (JSON)
- 2024Conformalized Answer Set Prediction for Knowledge Graph Embeddingcited by 5
- 2026Black-Box Reliability Certification for AI Agents via Self-Consistency Sampling and Conformal Calibrationcited by 2
- 2026Beyond Surface Statistics: Robust Conformal Prediction for LLMs via Internal Representationscited by 1
- 2026Online Shift Detection and Conformal Adaptation for Deployed Safety Classifierscited by 1
- 2026Concise and Logically Consistent Conformal Sets for Neuro-Symbolic Concept-Based Modelscited by 0
- 2026Range-GRPO: Policy Optimization via Pairwise Relations among Reward Intervalscited by 0
- 2026Range-GRPO: Policy Optimization via Pairwise Relations among Reward Intervals1 Oct 2026
- 2026Online Shift Detection and Conformal Adaptation for Deployed Safety Classifiers10 Jun 2026
- 2026Concise and Logically Consistent Conformal Sets for Neuro-Symbolic Concept-Based Models18 May 2026
- 2026Beyond Surface Statistics: Robust Conformal Prediction for LLMs via Internal Representations17 Apr 2026
- 2026Black-Box Reliability Certification for AI Agents via Self-Consistency Sampling and Conformal Calibration24 Feb 2026
- 2024Conformalized Answer Set Prediction for Knowledge Graph Embedding15 Aug 2024
- 2023Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hackingcited by 195
- 2025Conformal Tail Risk Control for Large Language Model Alignmentcited by 8
- 2026Calibrate, Don't Curate: Label-Efficient Estimation from Noisy LLM Judgescited by 4
- 2026Uncertainty-Aware Reward Modeling for Stable RLHFcited by 4
- 2026Uncertainty-Aware Reward Modeling for Stable RLHF18 Jun 2026
- 2026Calibrate, Don't Curate: Label-Efficient Estimation from Noisy LLM Judges10 May 2026
- 2025Conformal Tail Risk Control for Large Language Model Alignment27 Feb 2025
- 2023Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking14 Dec 2023
- 2025Membership Inference Attacks with False Discovery Rate Controlcited by 2
- 2025CertDW: Towards Certified Dataset Ownership Verification via Conformal Calibrationcited by 0
- 2025Conformal Unlearning: A New Paradigm for Unlearning in Conformal Predictorscited by 0
- 2026Available Guardrails: Certifying Selective Prediction across ML Systemscited by 0
- 2026Available Guardrails: Certifying Selective Prediction across ML Systems18 Sep 2026
- 2025Membership Inference Attacks with False Discovery Rate Control9 Aug 2025
- 2025Conformal Unlearning: A New Paradigm for Unlearning in Conformal Predictors5 Aug 2025
- 2025CertDW: Towards Certified Dataset Ownership Verification via Conformal Calibration16 Jun 2025
- 2026Trust Guided Decision Transformer25 Sep 2026
- 2026UNIQ: Conformal Calibration for Adaptive Conservatism in Offline Reinforcement Learning28 May 2026
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 360
- 2022Conformal Risk Controlcited by 290
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
- 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 256
- 2022Adaptive Conformal Predictions for Time Seriescited by 155
- 2024Language Models with Conformal Factuality Guaranteescited by 128
- 2022Conformal Inference for Online Prediction with Arbitrary Distribution Shiftscited by 123
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 99
- 2023Conformal PID Control for Time Series Predictioncited by 85
- 2023Improved Online Conformal Prediction via Strongly Adaptive Online Learningcited by 76
- 2022Selection by Prediction with Conformal p-valuescited by 66
12 most cited of 485 All 485 (JSON)
- 2026SimplexUQ: An Evaluation Framework and Benchmark for Conformal Uncertainty on Simplex-Valued Predictions30 Sep 2026
- 2026Adaptive Safety Filtering for Frozen ACC Policies via Conformal Residual Calibration28 Sep 2026
- 2026Risk-Controlled Selective LLM Answering by Pricing Label-Free Checks27 Sep 2026
- 2026RSD-Poker: Structure-Adaptive and Shift-Robust Risk-Utility Certification for Residual Policies in Imperfect-Information Games27 Sep 2026
- 2026Sharp training-conditional coverage for conformal prediction under covariate shift27 Sep 2026
- 2026RAEGL: Risk-Aware Evidence-Gated Learning for Selective Contextual Routing under Temporal Shift27 Sep 2026
- 2026When Can Old Evaluations Certify a New Model? Label-Efficient Release Decisions under Evaluator Drift26 Sep 2026
- 2026Multivariate conformal uncertainty propagation in multitask atomistic simulation: Successes and pitfalls25 Sep 2026
- 2026Conformal Prediction under Exponential-Tilt Joint Shift25 Sep 2026
- 2026Missingness-Aware Conformal Prediction Under Cross-Hospital Distribution Shift25 Sep 2026
- 2026Transfer Learning with Conformalized Quantile Regression for Solar PV Forecasting Under Load-Shedding-Driven Data Scarcity22 Sep 2026
- 2026PICPIs: Prediction-Interval-Conditional Prediction Intervals21 Sep 2026
12 newest of 485 All 485 (JSON)