Structured Uncertainty Prediction Networks
Not on the map. Why?
Abstract (arXiv)
This paper is the first work to propose a network to predict a structured uncertainty distribution for a synthesized image. Previous approaches have been mostly limited to predicting diagonal covariance matrices. Our novel model learns to predict a full Gaussian covariance matrix for each reconstruction, which permits efficient sampling and likelihood evaluation. We demonstrate that our model can accurately reconstruct ground truth correlated residual distributions for synthetic datasets and generate plausible high frequency samples for real face images. We also illustrate the use of these predicted covariances for structure preserving image denoising.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 6; 2024: 4; 2025: 7; 2026: 5.
34 papers.
Sort:
By area:
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2024Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariancecited by 42
- 2021Interpretable Unsupervised Diversity Denoising and Artefact Removalcited by 26
- 2021A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applicationscited by 24
- 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecastingcited by 17
- 2023Learning a Depth Covariance Functioncited by 16
- 2023Uncertainty Quantification via Neural Posterior Principal Componentscited by 16
- 2022Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecastingcited by 13
- 2021Bayesian multiscale deep generative model for the solution of high-dimensional inverse problemscited by 12
- 2022VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimationcited by 9
- 2022Learning Structured Gaussians to Approximate Deep Ensemblescited by 8
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detectioncited by 7
22 more
- 2022MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interactioncited by 6
- 2023GUPNet++: Geometry Uncertainty Propagation Network for Monocular 3D Object Detectioncited by 5
- 2021Covariance Prediction via Convex Optimizationcited by 4
- 2022Compressed Sensing MRI Reconstruction Regularized by VAEs with Structured Image Covariancecited by 4
- 2023TIC-TAC: A Framework for Improved Covariance Estimation in Deep Heteroscedastic Regressioncited by 4
- 2024Hierarchical Uncertainty Exploration via Feedforward Posterior Treescited by 4
- 2022Structured Uncertainty in the Observation Space of Variational Autoencoderscited by 3
- 2023Uncertainty Visualization via Low-Dimensional Posterior Projectionscited by 3
- 2024GUIDE-VAE: Advancing Data Generation with User Information and Pattern Dictionariescited by 3
- 2025Feature Hallucination for Self-supervised Action Recognitioncited by 3
- 2025Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regressioncited by 2
- 2025Probabilistic bias adjustment of seasonal predictions of Arctic Sea Ice Concentrationcited by 2
- 2024Deep priors for satellite image restoration with accurate uncertaintiescited by 1
- 2026Toward generative machine learning for boosting ensembles of climate simulationscited by 1
- 2022Variational Heteroscedastic Volatility Modelcited by 0
- 2025Likelihood-Free Variational Autoencoderscited by 0
- 2025SAFER: A Calibrated Risk-Aware Multimodal Recommendation Model for Dynamic Treatment Regimescited by 0
- 2025Structured Uncertainty Similarity Score (SUSS): Learning a Probabilistic, Interpretable, Perceptual Metric Between Imagescited by 0
- 2026Self-Supervised Uncertainty Estimation For Super-Resolution of Satellite Imagescited by 0
- 2026Structured SIR: Efficient and Expressive Importance-Weighted Inference for High-Dimensional Image Registrationcited by 0
- 2026Probabilistic bias adjustment of seasonal forecasts using generative machine learning: A case study of Arctic sea ice predictionscited by 0
- 2026It depends: Incorporating correlations for joint aleatoric and epistemic uncertainties of high-dimensional output spacescited by 0
- 2026It depends: Incorporating correlations for joint aleatoric and epistemic uncertainties of high-dimensional output spaces25 Aug 2026
- 2026Probabilistic bias adjustment of seasonal forecasts using generative machine learning: A case study of Arctic sea ice predictions27 May 2026
- 2026Structured SIR: Efficient and Expressive Importance-Weighted Inference for High-Dimensional Image Registration18 Mar 2026
- 2026Self-Supervised Uncertainty Estimation For Super-Resolution of Satellite Images14 Mar 2026
- 2026Toward generative machine learning for boosting ensembles of climate simulations6 Feb 2026
- 2025Structured Uncertainty Similarity Score (SUSS): Learning a Probabilistic, Interpretable, Perceptual Metric Between Images3 Dec 2025
- 2025Probabilistic bias adjustment of seasonal predictions of Arctic Sea Ice Concentration10 Oct 2025
- 2025Feature Hallucination for Self-supervised Action Recognition25 Jun 2025
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detection23 Jun 2025
- 2025SAFER: A Calibrated Risk-Aware Multimodal Recommendation Model for Dynamic Treatment Regimes7 Jun 2025
- 2025Likelihood-Free Variational Autoencoders24 Apr 2025
- 2025Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression14 Feb 2025
22 more
- 2024Deep priors for satellite image restoration with accurate uncertainties5 Dec 2024
- 2024GUIDE-VAE: Advancing Data Generation with User Information and Pattern Dictionaries6 Nov 2024
- 2024Hierarchical Uncertainty Exploration via Feedforward Posterior Trees24 May 2024
- 2024Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariance3 Feb 2024
- 2023Uncertainty Visualization via Low-Dimensional Posterior Projections12 Dec 2023
- 2023TIC-TAC: A Framework for Improved Covariance Estimation in Deep Heteroscedastic Regression29 Oct 2023
- 2023GUPNet++: Geometry Uncertainty Propagation Network for Monocular 3D Object Detection24 Oct 2023
- 2023Uncertainty Quantification via Neural Posterior Principal Components27 Sep 2023
- 2023Learning a Depth Covariance Function21 Mar 2023
- 2023A Survey on Uncertainty Quantification Methods for Deep Learning26 Feb 2023
- 2022Compressed Sensing MRI Reconstruction Regularized by VAEs with Structured Image Covariance26 Oct 2022
- 2022MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction22 Oct 2022
- 2022VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimation12 Oct 2022
- 2022Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecasting11 Jul 2022
- 2022Structured Uncertainty in the Observation Space of Variational Autoencoders25 May 2022
- 2022Variational Heteroscedastic Volatility Model11 Apr 2022
- 2022Learning Structured Gaussians to Approximate Deep Ensembles29 Mar 2022
- 2021A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications3 Nov 2021
- 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecasting26 Oct 2021
- 2021Interpretable Unsupervised Diversity Denoising and Artefact Removal3 Apr 2021
- 2021Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems4 Feb 2021
- 2021Covariance Prediction via Convex Optimization29 Jan 2021
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2021Interpretable Unsupervised Diversity Denoising and Artefact Removalcited by 26
- 2021A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applicationscited by 24
- 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecastingcited by 17
- 2023Learning a Depth Covariance Functioncited by 16
- 2023Uncertainty Quantification via Neural Posterior Principal Componentscited by 16
- 2022Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecastingcited by 13
- 2021Bayesian multiscale deep generative model for the solution of high-dimensional inverse problemscited by 12
- 2022VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimationcited by 9
- 2022Learning Structured Gaussians to Approximate Deep Ensemblescited by 8
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detectioncited by 7
- 2022MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interactioncited by 6
12 most cited of 33 All 33 (JSON)
- 2026It depends: Incorporating correlations for joint aleatoric and epistemic uncertainties of high-dimensional output spaces25 Aug 2026
- 2026Probabilistic bias adjustment of seasonal forecasts using generative machine learning: A case study of Arctic sea ice predictions27 May 2026
- 2026Structured SIR: Efficient and Expressive Importance-Weighted Inference for High-Dimensional Image Registration18 Mar 2026
- 2026Self-Supervised Uncertainty Estimation For Super-Resolution of Satellite Images14 Mar 2026
- 2026Toward generative machine learning for boosting ensembles of climate simulations6 Feb 2026
- 2025Structured Uncertainty Similarity Score (SUSS): Learning a Probabilistic, Interpretable, Perceptual Metric Between Images3 Dec 2025
- 2025Probabilistic bias adjustment of seasonal predictions of Arctic Sea Ice Concentration10 Oct 2025
- 2025Feature Hallucination for Self-supervised Action Recognition25 Jun 2025
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detection23 Jun 2025
- 2025SAFER: A Calibrated Risk-Aware Multimodal Recommendation Model for Dynamic Treatment Regimes7 Jun 2025
- 2025Likelihood-Free Variational Autoencoders24 Apr 2025
- 2025Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression14 Feb 2025
12 newest of 33 All 33 (JSON)