Posterior Information Dynamics of Diffusion Models for Linear Inverse Problems
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion models are widely used as priors for linear inverse problems, yet endpoint quality does not reveal when measurement information enters reverse denoising or how it is allocated across signal directions. We study this process through the smoothed likelihood force, the difference between exact posterior and prior scores at each noise level. For a fixed measurement, its expected squared norm gives both posterior--prior relative-entropy dissipation and reverse-path relative-entropy growth. Averaging over measurements yields an information--minimum mean-square error (I-MMSE) identity linking information gain to denoising-error reduction. Under finite second moments, the force energy and its ratio to prior-score energy decay quadratically in the noising kernel's signal coefficient at high noise. Solvable models show that conditioning removes class separation already explained by the measurement, reduces a uniform index entropy over (n) empirical samples from (log n) to (H(Imid r)), and makes assimilation depend on operator--prior alignment even for identical singular values. Experiments in models with tractable posteriors evaluate these predictions. In a separate illustration with a frozen FFHQ model, masks sharing the same spectrum yield different prior-normalized null-space trajectory statistics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 39 of its 57 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
39 of 57 references.
Closest ancestors · 10
Same direction, newest first
- 2026Provable diffusion-based posterior sampling for linear inverse problems via DDIM21 Jul
- 2026A Stabilized Path-Space Approach to Diffusion-Based Posterior Sampling10 Jun
- 2026Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability7 May
- 2024Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariance3 Feb
- 2023Denoising Diffusion Models for Plug-and-Play Image Restoration15 May
- 2023A Variational Perspective on Solving Inverse Problems with Diffusion Models7 May
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
- 2022Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems20 Nov
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
- 2022Denoising Diffusion Restoration Models27 Jan
Other references · 29
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2023Extracting Training Data from Diffusion Modelscited by 732
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 286
- 2023Practical and Asymptotically Exact Conditional Sampling in Diffusion Modelscited by 232
- 2024Dynamical Regimes of Diffusion Modelscited by 142
17 more
- 2024A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Datacited by 93
- 2023Spontaneous Symmetry Breaking in Generative Diffusion Modelscited by 80
- 2024Critical windows: non-asymptotic theory for feature emergence in diffusion modelscited by 47
- 2023Information-Theoretic Diffusioncited by 44
- 2023The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instabilitycited by 39
- 2023MINDE: Mutual Information Neural Diffusion Estimationcited by 31
- 2022Quantized Compressed Sensing with Score-based Generative Modelscited by 15
- 2026Theory of Speciation Transitions in Diffusion Models with General Class Structurecited by 10
- 2026The Entropic Signature of Class Speciation in Diffusion Modelscited by 9
- 2023QCM-SGM+: Improved Quantized Compressed Sensing With Score-Based Generative Modelscited by 4
- 2026Dynamical Regimes of Multimodal Diffusion Modelscited by 4
- 2025Conditional Mutual Information Based Diffusion Posterior Sampling for Solving Inverse Problemscited by 3
- 2025MMG: Mutual Information Estimation via the MMSE Gap in Diffusioncited by 3
- 2026Steering Dynamical Regimes of Diffusion Models by Breaking Detailed Balancecited by 3
- 2026An exact information theory of generalization phase transitions in Bayesian diffusion modelscited by 3
- 2026An analytic theory of convolutional neural network inverse problems solverscited by 2
- 2026Exact Posterior Score Estimation for Solving Linear Inverse Problemscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors
- 2023Removing Structured Noise with Diffusion Models
- 2026Posterior Continuation with Noise-Conditioned Frequency Exposure for Diffusion Inverse Problems
- 2024Learning Diffusion Model from Noisy Measurement using Principled Expectation-Maximization Method
- 2025Solving Diffusion Inverse Problems with Restart Posterior Sampling
- 2025A Recovery Theory for Diffusion Priors: Deterministic Analysis of the Implicit Prior Algorithm
- 2026A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- 2024There and Back Again: On the relation between Noise and Image Inversions in Diffusion Models