Distribution-Free Predictive Inference For Regression
Not on the map. Why?
Abstract (arXiv)
We develop a general framework for distribution-free predictive inference in regression, using conformal inference. The proposed methodology allows for the construction of a prediction band for the response variable using any estimator of the regression function. The resulting prediction band preserves the consistency properties of the original estimator under standard assumptions, while guaranteeing finite-sample marginal coverage even when these assumptions do not hold. We analyze and compare, both empirically and theoretically, the two major variants of our conformal framework: full conformal inference and split conformal inference, along with a related jackknife method. These methods offer different tradeoffs between statistical accuracy (length of resulting prediction intervals) and computational efficiency. As extensions, we develop a method for constructing valid in-sample prediction intervals called it rank-one-out conformal inference, which has essentially the same computational efficiency as split conformal inference. We also describe an extension of our procedures for producing prediction bands with locally varying length, in order to adapt to heteroskedascity in the data. Finally, we propose a model-free notion of variable importance, called it leave-one-covariate-out or LOCO inference. Accompanying this paper is an R package tt conformalInference that implements all of the proposals we have introduced. In the spirit of reproducibility, all of our empirical results can also be easily (re)generated using this package.
Key facts. Cited by 657 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 42; 2022: 70; 2023: 79; 2024: 110; 2025: 149; 2026: 207.
657 papers.
Sort:
By area:
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 360
- 2022Conformal Risk Controlcited by 290
- 2023Conformal Language Modelingcited by 163
- 2022Adaptive Conformal Predictions for Time Seriescited by 155
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2023Class-Conditional Conformal Prediction with Many Classescited by 109
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 99
- 2024C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersioncited by 82
- 2021Conformal Prediction using Conditional Histogramscited by 77
- 2022Batch Multivalid Conformal Predictioncited by 66
- 2022Selection by Prediction with Conformal p-valuescited by 66
38 more
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
- 2022Training Uncertainty-Aware Classifiers with Conformalized Deep Learningcited by 62
- 2021Few-shot Conformal Prediction with Auxiliary Taskscited by 53
- 2021Conformalized Survival Analysiscited by 53
- 2022Conformal Prediction Under Feedback Covariate Shift for Biomolecular Designcited by 53
- 2024Conformal Prediction for Natural Language Processing: A Surveycited by 52
- 2024Conformal Alignment: Knowing When to Trust Foundation Models with Guaranteescited by 50
- 2021Conformal Uncertainty Sets for Robust Optimizationcited by 49
- 2021Online Multivalid Learning: Means, Moments, and Prediction Intervalscited by 48
- 2022Probabilistic Conformal Prediction Using Conditional Random Samplescited by 47
- 2023Federated Conformal Predictors for Distributed Uncertainty Quantificationcited by 46
- 2024Length Optimization in Conformal Predictioncited by 39
- 2022Achieving Risk Control in Online Learning Settingscited by 38
- 2025Decision Theoretic Foundations for Conformal Prediction: Optimal Uncertainty Quantification for Risk-Averse Agentscited by 37
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2022On the Utility of Prediction Sets in Human-AI Teamscited by 34
- 2022Predictive Inference with Feature Conformal Predictioncited by 33
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagationcited by 33
- 2023The Rashomon Importance Distribution: Getting RID of Unstable, Single Model-based Variable Importancecited by 29
- 2022Conformal Prediction Sets with Limited False Positivescited by 28
- 2022Distribution Free Prediction Sets for Node Classificationcited by 28
- 2022Copula Conformal Prediction for Multi-step Time Series Forecastingcited by 28
- 2023Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problemscited by 28
- 2021Set-valued classification -- overview via a unified frameworkcited by 27
- 2023One-Shot Federated Conformal Predictioncited by 26
- 2022Efficient and Differentiable Conformal Prediction with General Function Classescited by 25
- 2022Conformal Prediction with Temporal Quantile Adjustmentscited by 25
- 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
- 2023Probabilistically robust conformal predictioncited by 25
- 2024Boosted Conformal Prediction Intervalscited by 25
- 2024Conformal Prediction: A Data Perspectivecited by 25
- 2025Minimum Volume Conformal Sets for Multivariate Regressioncited by 25
- 2021Locally Valid and Discriminative Prediction Intervals for Deep Learning Modelscited by 24
- 2023Conformal Prediction with Missing Valuescited by 24
- 2023Adaptive conformal classification with noisy labelscited by 24
- 2023Feature Importance: A Closer Look at Shapley Values and LOCOcited by 23
- 2023Conformal Meta-learners for Predictive Inference of Individual Treatment Effectscited by 23
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Predictioncited by 23
50 most cited of 657 All 657 (JSON)
- 2026SimplexUQ: An Evaluation Framework and Benchmark for Conformal Uncertainty on Simplex-Valued Predictions30 Sep 2026
- 2026Reserve-Aware Contrast Certificates for Conservative Bandits with Uncertain Baselines30 Sep 2026
- 2026One Threshold Does Not Fit All Languages: Language-Conditional Deferral for Reliable and Efficient Low-Resource Text Classification29 Sep 2026
- 2026Scaling Full Conformal Image Classifiers29 Sep 2026
- 2026Conformal Coverage of Time Series: Validity and Inference27 Sep 2026
- 2026Valid and Efficient Split Conformal Regression for Time Series27 Sep 2026
- 2026How Synthetic Labels Improve Conformal Prediction: A Perspective on Conditional Coverage27 Sep 2026
- 2026When Does a Skill Add Value? Task-Conditional Gain Prediction for Selective Skill Use26 Sep 2026
- 2026Conformal Prediction under Exponential-Tilt Joint Shift25 Sep 2026
- 2026Missingness-Aware Conformal Prediction Under Cross-Hospital Distribution Shift25 Sep 2026
- 2026Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physics24 Sep 2026
- 2026When Does Action Credit Need Updating?24 Sep 2026
38 more
- 2026GeoDose-CP: Graph-Local Conformal Inference for Continuous-Treatment Earth Observation24 Sep 2026
- 2026Rolling Conformal Prediction in Sequential Model Training22 Sep 2026
- 2026When Are Aggregate Agent Traces Diagnosable? Traffic-Governed Interpretation and Calibrated Abstention22 Sep 2026
- 2026PICPIs: Prediction-Interval-Conditional Prediction Intervals21 Sep 2026
- 2026The Undetected Damage of Quantization on Retrieval and How to Fix It21 Sep 2026
- 2026PACE: Plug-and-Play Contextual Embedding for Feature Screening with Pretrained Tabular Foundation Models20 Sep 2026
- 2026Reliability-Centered Evaluation of Sparse Longitudinal CT Lesion-Size Forecasting with Conformal Interval Calibration and Gompertz-Inspired Regularization18 Sep 2026
- 2026Refuse, Decompose, Refresh: A Claim-Safe Protocol for Closed-Loop AI Evaluation17 Sep 2026
- 2026Null importance: Disentangling relevance for interpretable machine learning16 Sep 2026
- 2026ENCP: Episode-Normalized Conformal Prediction for Vision-and-Language Navigation15 Sep 2026
- 2026Scaling-Score Conformal Prediction for Multi-Target Regression15 Sep 2026
- 2026SeqMaestro: From nucleotide sequences to biological hypotheses through interpretable machine learning14 Sep 2026
- 2026Interpreting the predictions of neural network classification based on a Taylor Coefficient Analysis (TCA)11 Sep 2026
- 2026CHOIR: heterogeneity-aware conformal prediction for crash injury severity across driver safety strata10 Sep 2026
- 2026Conformal Calibration Transfer9 Sep 2026
- 2026Selective boundary condition reduction via learned error gating8 Sep 2026
- 2026Occupancy-based Quantile Risk Control2 Sep 2026
- 2026Exact Risk-Complexity Laws for Projective Boundaries in Scenario Optimization and Distribution-Free Certification1 Sep 2026
- 2026Towards a Reliable and Practical Eval Pipeline1 Sep 2026
- 2026ToxLens: A Reproducible Graph-Learning Framework for Leakage-Aware, Uncertainty-Calibrated Molecular Toxicity Prediction31 Aug 2026
- 2026Rethinking the Test-Time Prompt Tuning Objective from the Perspective of Calibration31 Aug 2026
- 2026A Unified Perspective on Conformal Prediction and Wasserstein Distributionally Robust Optimization for Uncertainty Quantification30 Aug 2026
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026Optimal Recovery Meets Bayesian Learning: Where Worst-Case Bounds Pay Off29 Aug 2026
- 2026Gaussian Process Decorrelation for Spatiotemporal Deep Learning-Based Snow Water Equivalent Prediction27 Aug 2026
- 2026TRACE-CRC: Trajectory-Adaptive Conformal Risk Control for Multi-Step Channel State Information Prediction27 Aug 2026
- 2026Conformal Bayes under Continuous Label Shift: Sensitivity Analysis and the Limits of Exact Validity24 Aug 2026
- 2026Replicable Conformal Prediction23 Aug 2026
- 2026When Does AI for PDEs Yield Scientific Evidence?23 Aug 2026
- 2026SPARC: Single-Pass Scaling for Motion Forecasting with Conformal Bayesian Last Layers21 Aug 2026
- 2026CAS: Conformalized Agentic Search via Adaptive Retrieval and Policy Weighting21 Aug 2026
- 2026SCAPE: Scenario-Conditioned Simulation-Augmented Policy Evaluation19 Aug 2026
- 2026L'evy Attention: Single-Pass Predictive Uncertainty for Continuous-Time Attention19 Aug 2026
- 2026Bound-Aware Per-Organ Recall Risk Control for Multi-Organ CT Segmentation under Clinical Domain Shift18 Aug 2026
- 2026SPACE: Sample-cloud Predictive Adaptive Conformal Ellipsoids for Multivariate Time-Series Forecasting18 Aug 2026
- 2026Temporal Graph Prototype-conditioned Conformal Prediction for Fraud Detection16 Aug 2026
- 2026FAST-DeepONet: Factor-Augmented Branch Representations for High-Dimensional PDE Inputs in the Small-Sample Regime15 Aug 2026
- 2026Structure-preserving uncertainty quantification for GENERIC dynamics12 Aug 2026
50 newest of 657 All 657 (JSON)
- 2024C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersioncited by 82
- 2025Conformal Prediction for Zero-Shot Modelscited by 14
- 2025Full Conformal Adaptation of Medical Vision-Language Modelscited by 9
- 2025Trustworthy Few-Shot Transfer of Medical VLMs through Split Conformal Predictioncited by 8
- 2025A-TPT: Angular Diversity Calibration Properties for Test-Time Prompt Tuning of Vision-Language Modelscited by 3
- 2026LATA: Laplacian-Assisted Transductive Adaptation for Conformal Uncertainty in Medical VLMscited by 2
- 2026Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via Data-Free Flatness-Aware Prompt Pretrainingcited by 2
- 2026Uncertainty Quantification for Computer-Use Agents: A Benchmark across Vision-Language Models and GUI Grounding Datasetscited by 2
- 2026Uncertainty Quantification for Computer-Use Agents: A Benchmark across Vision-Language Models and GUI Grounding Datasets24 Jun 2026
- 2026Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via Data-Free Flatness-Aware Prompt Pretraining30 Apr 2026
- 2026LATA: Laplacian-Assisted Transductive Adaptation for Conformal Uncertainty in Medical VLMs19 Feb 2026
- 2025A-TPT: Angular Diversity Calibration Properties for Test-Time Prompt Tuning of Vision-Language Models30 Oct 2025
- 2025Trustworthy Few-Shot Transfer of Medical VLMs through Split Conformal Prediction20 Jun 2025
- 2025Full Conformal Adaptation of Medical Vision-Language Models6 Jun 2025
- 2025Conformal Prediction for Zero-Shot Models30 May 2025
- 2024C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersion21 Mar 2024
- 2024Conformalized Answer Set Prediction for Knowledge Graph Embeddingcited by 5
- 2025Leveraging Predictive Equivalence in Decision Treescited by 4
- 2025ATTS: Asynchronous Test-Time Scaling via Conformal Predictioncited by 3
- 2025A note on conditional PAC-efficient reasoning in large language model routingcited by 3
- 2026Budgeted Act-or-Defer Multi-Agent LLM Deliberation with Local Reliability Boundscited by 1
- 2026Concise and Logically Consistent Conformal Sets for Neuro-Symbolic Concept-Based Modelscited by 0
- 2026Budgeted Act-or-Defer Multi-Agent LLM Deliberation with Local Reliability Bounds28 Jun 2026
- 2026Concise and Logically Consistent Conformal Sets for Neuro-Symbolic Concept-Based Models18 May 2026
- 2025A note on conditional PAC-efficient reasoning in large language model routing25 Nov 2025
- 2025ATTS: Asynchronous Test-Time Scaling via Conformal Prediction18 Sep 2025
- 2025Leveraging Predictive Equivalence in Decision Trees17 Jun 2025
- 2024Conformalized Answer Set Prediction for Knowledge Graph Embedding15 Aug 2024
- 2026BAGEN: Are LLM Agents Budget-Aware?cited by 12
- 2026Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascadecited by 4
- 2026Certified Speculative Execution for Untrusted AI Agentscited by 1
- 2026Beyond Aggregate Risk: Role-Stratified Conformal Risk Control for LLM Tool Callscited by 0
- 2026CAS: Conformalized Agentic Search via Adaptive Retrieval and Policy Weightingcited by 0
- 2026CAS: Conformalized Agentic Search via Adaptive Retrieval and Policy Weighting21 Aug 2026
- 2026Beyond Aggregate Risk: Role-Stratified Conformal Risk Control for LLM Tool Calls27 Jul 2026
- 2026Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade7 Jul 2026
- 2026Certified Speculative Execution for Untrusted AI Agents30 Jun 2026
- 2026BAGEN: Are LLM Agents Budget-Aware?29 May 2026
- 2024Model Free Prediction with Uncertainty Assessmentcited by 3
- 2025From Uncertain to Safe: Conformal Adaptation of Diffusion Models for Safe PDE Controlcited by 3
- 2024Conformal Diffusion Models for Individual Treatment Effect Estimation and Inferencecited by 1
- 2025Diffusion-Driven High-Dimensional Variable Selectioncited by 0
- 2026TRACE: Transport Alignment Conformal Prediction via Diffusion and Flow Matching Modelscited by 0
- 2026TRACE: Transport Alignment Conformal Prediction via Diffusion and Flow Matching Models8 May 2026
- 2025Diffusion-Driven High-Dimensional Variable Selection19 Aug 2025
- 2025From Uncertain to Safe: Conformal Adaptation of Diffusion Models for Safe PDE Control4 Feb 2025
- 2024Conformal Diffusion Models for Individual Treatment Effect Estimation and Inference2 Aug 2024
- 2024Model Free Prediction with Uncertainty Assessment21 May 2024
- 2026PASC: Pipeline-Aware Conformal Prediction with Joint Coverage Guarantees for Multi-Stage NLP and LLM Pipelinescited by 7
- 2025Principled Context Engineering for RAG: Statistical Guarantees via Conformal Predictioncited by 6
- 2025The Semantic Illusion: Certified Limits of Embedding-Based Hallucination Detection in RAG Systemscited by 0
- 2026PASC: Pipeline-Aware Conformal Prediction with Joint Coverage Guarantees for Multi-Stage NLP and LLM Pipelines12 May 2026
- 2025The Semantic Illusion: Certified Limits of Embedding-Based Hallucination Detection in RAG Systems17 Dec 2025
- 2025Principled Context Engineering for RAG: Statistical Guarantees via Conformal Prediction22 Nov 2025
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 360
- 2022Conformal Risk Controlcited by 290
- 2023Conformal Language Modelingcited by 163
- 2022Adaptive Conformal Predictions for Time Seriescited by 155
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2023Class-Conditional Conformal Prediction with Many Classescited by 109
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 99
- 2021Conformal Prediction using Conditional Histogramscited by 77
- 2022Batch Multivalid Conformal Predictioncited by 66
- 2022Selection by Prediction with Conformal p-valuescited by 66
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
12 most cited of 616 All 616 (JSON)
- 2026SimplexUQ: An Evaluation Framework and Benchmark for Conformal Uncertainty on Simplex-Valued Predictions30 Sep 2026
- 2026Reserve-Aware Contrast Certificates for Conservative Bandits with Uncertain Baselines30 Sep 2026
- 2026One Threshold Does Not Fit All Languages: Language-Conditional Deferral for Reliable and Efficient Low-Resource Text Classification29 Sep 2026
- 2026Scaling Full Conformal Image Classifiers29 Sep 2026
- 2026Conformal Coverage of Time Series: Validity and Inference27 Sep 2026
- 2026Valid and Efficient Split Conformal Regression for Time Series27 Sep 2026
- 2026How Synthetic Labels Improve Conformal Prediction: A Perspective on Conditional Coverage27 Sep 2026
- 2026When Does a Skill Add Value? Task-Conditional Gain Prediction for Selective Skill Use26 Sep 2026
- 2026Conformal Prediction under Exponential-Tilt Joint Shift25 Sep 2026
- 2026Missingness-Aware Conformal Prediction Under Cross-Hospital Distribution Shift25 Sep 2026
- 2026When Does Action Credit Need Updating?24 Sep 2026
- 2026GeoDose-CP: Graph-Local Conformal Inference for Continuous-Treatment Earth Observation24 Sep 2026
12 newest of 616 All 616 (JSON)