Patch-PODiff-ViT: Structured Latent Diffusion with Patchwise POD for Super-Resolution and Uncertainty Quantification
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion models enable probabilistic super-resolution and conditional generation, but pixel-space methods are computationally expensive and learned latent spaces often lack interpretable uncertainty quantification. We introduce Patch-PODiff-ViT, a structured latent diffusion framework in which the latent space is defined by patchwise Proper Orthogonal Decomposition (POD), a fixed linear orthonormal basis over local patches, rather than learned by a nonlinear autoencoder. This yields low-dimensional, variance-ordered tokens that preserve spatial structure and enable efficient diffusion in a structured low-dimensional latent space with a Vision Transformer. Because the decoder is fixed, linear, and orthonormal, latent coefficient uncertainty can be propagated directly to physical-space predictive variance, enabling analytic propagation of predictive variance through the linear decoder without Monte Carlo estimation in pixel space. Across sea surface temperature, medical imaging, and natural images, the method achieves strong reconstruction with fewer parameters and lower memory, while producing well-calibrated spatial uncertainty that closely matches empirical ensembles.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 21 of its 31 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
21 of 31 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2021Score-based Generative Modeling in Latent Spacecited by 636
8 more
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
- 2023Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscalingcited by 110
- 2020Stochastic Super-Resolution for Downscaling Time-Evolving Atmospheric Fields with a Generative Adversarial Networkcited by 70
- 2023Latent diffusion models for generative precipitation nowcasting with accurate uncertainty quantificationcited by 56
- 2024Generative Diffusion-based Downscaling for Climatecited by 25
- 2019Uncertainty Quantification with Generative Modelscited by 17
- 2023Generative Adversarial Reduced Order Modellingcited by 7
- 2026PODiff: Latent Diffusion in Proper Orthogonal Decomposition Space for Scientific Super-Resolutioncited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025PSI3D: Plug-and-Play 3D Stochastic Inference with Slice-wise Latent Diffusion Prior
- 2025BUFF: Bayesian Uncertainty Guided Diffusion Probabilistic Model for Single Image Super-Resolution
- 2026Learning Interpretable PDE Representations for Generative Reconstructions with Structured Sparsity
- 2026A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- 2026Uncertainty-Guided Latent Diffusion Models for Faithful Super Resolution
- 2026Latent Annealed Posterior Sampling with a Variance-Preserving Bridge for Sparsely Observed Random Fields
- 2023Image Super-resolution Via Latent Diffusion: A Sampling-space Mixture Of Experts And Frequency-augmented Decoder Approach
- 2025APT: Improving Diffusion Models for High Resolution Image Generation with Adaptive Path Tracing