Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey
Not on the map. Why?
Abstract (arXiv)
Machine learning methods are increasingly widely used in high-risk settings such as healthcare, transportation, and finance. In these settings, it is important that a model produces calibrated uncertainty to reflect its own confidence and avoid failures. In this paper we survey recent works on uncertainty quantification (UQ) for deep learning, in particular distribution-free Conformal Prediction method for its mathematical properties and wide applicability. We will cover the theoretical guarantees of conformal methods, introduce techniques that improve calibration and efficiency for UQ in the context of spatiotemporal data, and discuss the role of UQ in the context of safe decision making.
Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 51 of its 92 references that are in the map. First posted on arXiv 8 Sep 2022.
Builds on
51 of 92 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2013Auto-Encoding Variational Bayescited by 4,024
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,902
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,340
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,008
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 817
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 786
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 754
- 2016Distribution-Free Predictive Inference For Regressioncited by 660
- 2019Conformalized Quantile Regressioncited by 625
- 2019Conformal Prediction Under Covariate Shiftcited by 513
38 more
- 2015Variational Dropout and the Local Reparameterization Trickcited by 490
- 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 422
- 2020Classification with Valid and Adaptive Coveragecited by 393
- 2021Revisiting the Calibration of Modern Neural Networkscited by 388
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 367
- 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 360
- 2022Conformal prediction beyond exchangeabilitycited by 351
- 2014Stochastic Gradient Hamiltonian Monte Carlocited by 341
- 2017Stochastic Gradient Descent as Approximate Bayesian Inferencecited by 299
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 282
- 2017Concrete Dropoutcited by 227
- 2015A Theoretically Grounded Application of Dropout in Recurrent Neural Networkscited by 161
- 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
- 2020Conformal Inference of Counterfactuals and Individual Treatment Effectscited by 150
- 2019High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processescited by 147
- 2018High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approachcited by 117
- 2022Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imagingcited by 107
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 99
- 2019A comparison of some conformal quantile regression methodscited by 76
- 2018The Description Length of Deep Learning Modelscited by 71
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
- 2019Flexible distribution-free conditional predictive bands using density estimatorscited by 64
- 2014Regression Conformal Prediction with Nearest Neighbourscited by 59
- 2019Adaptive, Distribution-Free Prediction Intervals for Deep Networkscited by 56
- 2020Predictive Inference Is Free with the Jackknife+-after-Bootstrapcited by 55
- 2021Copula-based conformal prediction for Multi-Target Regressioncited by 53
- 2021Conformalized Survival Analysiscited by 53
- 2021Conformal Uncertainty Sets for Robust Optimizationcited by 49
- 2020Learning Certified Control using Contraction Metriccited by 48
- 2021Quantifying Uncertainty in Deep Spatiotemporal Forecastingcited by 48
- 2021Selection and Aggregation of Conformal Prediction Setscited by 47
- 2019With Malice Towards None: Assessing Uncertainty via Equalized Coveragecited by 43
- 2021Sample-Efficient Safety Assurances using Conformal Predictioncited by 41
- 2022TACTiS: Transformer-Attentional Copulas for Time Seriescited by 38
- 2018Probabilistically Safe Robot Planning with Confidence-Based Human Predictionscited by 27
- 2022Failure Prediction with Statistical Guarantees for Vision-Based Robot Controlcited by 21
- 2020Frequentist Uncertainty in Recurrent Neural Networks via Blockwise Influence Functionscited by 18
- 2020Control Barriers in Bayesian Learning of System Dynamicscited by 17
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 5; 2025: 4; 2026: 1.
11 papers.
- 2024Conformal Prediction: A Data Perspectivecited by 25
- 2024Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Modelscited by 12
- 2024Uncertainty Quantification of Surrogate Models using Conformal Predictioncited by 11
- 2025Calibrated Physics-Informed Uncertainty Quantificationcited by 8
- 2022What's Behind the Mask: Estimating Uncertainty in Image-to-Image Problemscited by 5
- 2024Uncertainty quantification in metric spacescited by 3
- 2024Valid Error Bars for Neural Weather Models using Conformal Predictioncited by 3
- 2025Topology-Aware Conformal Prediction for Stream Networkscited by 3
- 2025Conformal and kNN Predictive Uncertainty Quantification Algorithms in Metric Spacescited by 2
- 2025Towards Reliable and Holistic Visual In-Context Learning Prompt Selectioncited by 2
- 2026Beyond Accuracy: Reliability and Uncertainty Estimation in Convolutional Neural Networkscited by 0
- 2026Beyond Accuracy: Reliability and Uncertainty Estimation in Convolutional Neural Networks11 Mar 2026
- 2025Towards Reliable and Holistic Visual In-Context Learning Prompt Selection30 Sep 2025
- 2025Conformal and kNN Predictive Uncertainty Quantification Algorithms in Metric Spaces21 Jul 2025
- 2025Topology-Aware Conformal Prediction for Stream Networks6 Mar 2025
- 2025Calibrated Physics-Informed Uncertainty Quantification6 Feb 2025
- 2024Conformal Prediction: A Data Perspective9 Oct 2024
- 2024Uncertainty Quantification of Surrogate Models using Conformal Prediction19 Aug 2024
- 2024Valid Error Bars for Neural Weather Models using Conformal Prediction20 Jun 2024
- 2024Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Models26 May 2024
- 2024Uncertainty quantification in metric spaces8 May 2024
- 2022What's Behind the Mask: Estimating Uncertainty in Image-to-Image Problems28 Nov 2022