mlsanityData to 14 Oct 2026

One Inverse Step is a Convex Program: Bayes-Limit Calibration of Diffusion Inversion

arXiv 2608.23094 ↗First posted 24 Aug 2026stat.ML cs.LGcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

One implicit DDIM inversion step is the cheapest probe of whether a pretrained diffusion model encodes local manifold geometry. It is the stationarity condition of an explicit potential, x-G(x)=nablaPsit(x), strongly convex at the Bayes limit with modulus exactly e-ht for the step's log-SNR gap ht - for every data law, schedule and point, with no manifold, reach or unimodality hypothesis. Three consequences must be kept apart. (i) The solution is unique at the Bayes limit; a second one requires the trained score to violate the posterior-covariance bound by 1/(1-e-ht), a hypothesis-free certificate of model error; the same bound makes contraction a schedule constant, ρgstar=1-e-ht<0.326 throughout the standard DDPM schedule. (ii) The solver can still fail: Picard iteration is unit-step gradient descent on Psit, unstable wherever λmax(nabla2Psit)>2, so oscillation certifies nothing; damping below 2/λmax cures it. (iii) The geometry lives in the convergence domain: on the scale-free depth w=rkappamax the oscillation shell sits at w=tfrac12, schedule-free, and the divergence shell at w=1/(1+ρgstar), with a measured finite-noise correction in |II|2. Exact scores reproduce both to within 0.54% on three classes; no trained score we probe shows a shell - a derived limitation, not a null result: the Fermi window conflicts with the model's own training support by 3.6-5.6×, and the trained Hessian-Lipschitz constant is 2-12% of the curvature the law reads, 0 on a ReLU net. Finally the unconditional ceiling σtλmax(sym,J)≤1, from Cov(x0mid xt)succeq0 alone, holds for the exact score to 3×10-7 but is violated in all DDPM CIFAR-10/CelebA-HQ-256 settings, by 1.26-4.66×.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 25 of its 70 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

25 of 70 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  8. 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 315
  9. 2023Generalization in diffusion models arises from geometry-adaptive harmonic representationscited by 185
  10. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 128
  11. 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
  12. 2021Stabilizing Equilibrium Models by Jacobian Regularizationcited by 72
13 more
  1. 2013The Information Geometry of Mirror Descentcited by 54
  2. 2023On Exact Inversion of DPM-Solverscited by 47
  3. 2022Deep Equilibrium Approaches to Diffusion Modelscited by 42
  4. 2024A Geometric View of Data Complexity: Efficient Local Intrinsic Dimension Estimation with Diffusion Modelscited by 42
  5. 2023Lightning-Fast Image Inversion and Editing for Text-to-Image Diffusion Modelscited by 35
  6. 2024Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusioncited by 32
  7. 2022LIDL: Local Intrinsic Dimension Estimation Using Approximate Likelihoodcited by 30
  8. 2024On gauge freedom, conservativity and intrinsic dimensionality estimation in diffusion modelscited by 23
  9. 2023Mathematical analysis of singularities in the diffusion model under the submanifold assumptioncited by 20
  10. 2025Diffusion Models and the Manifold Hypothesis: Log-Domain Smoothing is Geometry Adaptivecited by 20
  11. 2023Score-based generative models learn manifold-like structures with constrained mixingcited by 9
  12. 2025What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifoldcited by 6
  13. 2025A Connection Between Score Matching and Local Intrinsic Dimensioncited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Geometry-Aware Discretization Error of Diffusion Models
  2. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds
  3. 2024SITCOM: Step-wise Triple-Consistent Diffusion Sampling for Inverse Problems
  4. 2024Linearly Constrained Diffusion Implicit Models
  5. 2026Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability
  6. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraints
  7. 2024DMPlug: A Plug-in Method for Solving Inverse Problems with Diffusion Models
  8. 2024BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Models