Is your uncertainty map wrong, or is its target? Exact diagnostics for the Tweedie diagonal, and a gradient-free alternative
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
A diffusion model can predict a follow-up medical scan from a baseline, but a clinician needs a per-voxel map of where that prediction can be trusted. Many such maps approximate the diagonal of the Tweedie posterior covariance, and are evaluated against another approximation of it, so whether the estimator or the target limits them is unclear. We compute the exact diagonal on six checkpoints across fourteen model-corpus conditions. Hutchinson at M=200 tracks it at rank agreement of at least 0.92 everywhere, yet in four of the fourteen the exact diagonal is anti-correlated with the denoising error, reaching -0.13, so a faithful estimator reproduces that reversal. All four are real-image conditions; on the models' own samples the reversal does not appear, so evaluating on generated samples flatters this family. What limits these maps is the target, not the estimator. We then introduce Tweedie Probe-Tangent (T-PT), a gradient-free residual probe that corrupts one model-supported prediction repeatedly and measures the voxel-wise variance of the denoiser's response. T-PT reads a different functional of the same Jacobian, and its exact second-order form ranks with the diagonal wherever the diagonal reverses; at thirty probes it returns a map too unstable to reproduce that ranking, while Hutchinson at M=5 already reproduces it, so T-PT there is not evidence against the reversal. We offer it as an instrument, not a better approximation. On brain MRI at full resolution, where every Jacobian-based estimator we test runs out of memory, T-PT leads a twenty-chain Monte-Carlo ensemble on five of eight endpoints inside tissue and trails it on none, at 16x fewer network evaluations; over the whole volume the ensemble leads, and fifty chains close the tissue gap. On lung CT the ensemble is ahead throughout. Both lose most of their discrimination where the change is, which remains open.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 33 of its 47 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
33 of 47 references.
Closest ancestors · 5
Same direction, newest first
- 2025Temporally-Aware Diffusion Model for Brain Progression Modelling with Bidirectional Temporal Regularisation3 Sep
- 2024Enhancing Spatiotemporal Disease Progression Models via Latent Diffusion and Prior Knowledge6 May
- 2023Treatment-aware Diffusion Probabilistic Model for Longitudinal MRI Generation and Diffuse Glioma Growth Prediction11 Sep
- 2022Brain Imaging Generation with Latent Diffusion Models15 Sep
- 2021Diffusion Models for Implicit Image Segmentation Ensembles6 Dec
Other references · 28
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 278
16 more
- 2022Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Modelscited by 83
- 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
- 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
- 2024Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariancecited by 42
- 2023BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inferencecited by 30
- 2024Shedding Light on Large Generative Networks: Estimating Epistemic Uncertainty in Diffusion Modelscited by 22
- 2025Generative Uncertainty in Diffusion Modelscited by 20
- 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimationcited by 17
- 2025Unified Uncertainty-Aware Diffusion for Multi-Agent Trajectory Modelingcited by 15
- 2024Free Hunch: Denoiser Covariance Estimation for Diffusion Models Without Extra Costscited by 14
- 2024Improving Probabilistic Diffusion Models With Optimal Diagonal Covariance Matchingcited by 13
- 2024Enhancing Diffusion Models for Inverse Problems with Covariance-Aware Posterior Samplingcited by 5
- 2024Bayesian computation with generative diffusion models by Multilevel Monte Carlocited by 3
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modelingcited by 3
- 2026Covariance-aware sampling for Diffusion Modelscited by 1
- 2026MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating and Calibrating Diffusion Model-derived Uncertainty for Quantitative MRI Mapping
- 2026Denoising diffusion networks for normative modeling in neuroimaging
- 2025Integrating Anatomical Priors into a Causal Diffusion Model
- 2025Noisy MRI Reconstruction via MAP Estimation with an Implicit Deep-Denoiser Prior
- 2026Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey
- 2026Atlases Are Already Inside: Recovering Population Templates from Pretrained Diffusion Models
- 2026Measuring Effective Data Resolution in Guided Diffusion Posteriors