General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Model
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Computational imaging is crucial in many disciplines from autonomous driving to life sciences. However, traditional model-driven and iterative methods consume large computational power and lack scalability for imaging. Deep learning (DL) is effective in processing local-to-local patterns, but it struggles with handling universal global-to-local (nonlocal) patterns under current frameworks. To bridge this gap, we propose a novel DL framework that employs a progressive denoising strategy, named the deterministic diffusion model (DDM), to facilitate general computational imaging at a low cost. We experimentally demonstrate the efficient and faithful image reconstruction capabilities of DDM from nonlocal patterns, such as speckles from multimode fiber and intensity patterns of second harmonic generation, surpassing the capability of previous state-of-the-art DL algorithms. By embedding Bayesian inference into DDM, we establish a theoretical framework and provide experimental proof of its uncertainty quantification. This advancement ensures the predictive reliability of DDM, avoiding misjudgment in high-stakes scenarios. This versatile and integrable DDM framework can readily extend and improve the efficacy of existing DL-based imaging applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 35 of its 61 references that are in the map. First posted on arXiv 23 Aug 2024.
Builds on
35 of 61 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
23 more
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 275
- 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 268
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2017Concrete Dropoutcited by 227
- 2020Concept Whitening for Interpretable Image Recognitioncited by 225
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 204
- 2019On the Inductive Bias of Neural Tangent Kernelscited by 177
- 2023BiFormer: Vision Transformer with Bi-Level Routing Attentioncited by 150
- 2020Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imagingcited by 57
- 2020Non-line-of-sight Imagingcited by 41
- 2018Generative Adversarial Networks and Perceptual Losses for Video Super-Resolutioncited by 30
- 2019Reliable deep-learning-based phase imaging with uncertainty quantificationcited by 26
- 2018Deep speckle correlation: a deep learning approach towards scalable imaging through scattering mediacited by 23
- 2020Are Deep Neural Architectures Losing Information? Invertibility Is Indispensablecited by 9
- 2019The Cells Out of Sample (COOS) dataset and benchmarks for measuring out-of-sample generalization of image classifierscited by 3
- 2020Second Harmonic Imaging Enhanced by Deep Learning Deciphercited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Review
- 2024Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors
- 2026U-DAVI: Uncertainty-Aware Diffusion-Prior-Based Amortized Variational Inference for Image Reconstruction
- 2022Denoising Diffusion Restoration Models
- 2022Entropy-driven Sampling and Training Scheme for Conditional Diffusion Generation
- 2026A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- 2025Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projection
- 2026Patch-PODiff-ViT: Structured Latent Diffusion with Patchwise POD for Super-Resolution and Uncertainty Quantification