Solving Prior Distribution Mismatch in Diffusion Models via Optimal Transport
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion Models (DMs) have achieved remarkable progress in generative modeling. However, the mismatch between the forward terminal distribution and reverse initial distribution introduces prior error, leading to deviations of sampling trajectories from the true distribution and severely limiting model performance. This issue further triggers cascading problems, including non-zero Signal-to-Noise Ratio, accumulated denoising errors, degraded generation quality, and constrained sampling efficiency. To address this issue, this paper proposes a prior error elimination framework based on Optimal Transport (OT). Specifically, an OT map from the reverse initial distribution to the forward terminal distribution is constructed to achieve precise matching of the two distributions. Meanwhile, the upper bound of the prior error is quantified using the Wasserstein distance, proving that the prior error can be effectively eliminated via the OT map. Additionally, by deriving the asymptotic consistency between dynamic OT and probability flow, this method is revealed to be highly compatible with the intrinsic mechanism of the diffusion process. Experimental results demonstrate that the proposed method completely eliminates the prior error both theoretically and practically, providing a universal and rigorous solution for optimizing the performance of DMs.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 76 of its 118 references that are in the map. First posted on arXiv 17 Oct 2024.
Builds on
76 of 118 references.
Closest ancestors · 40
Same direction, newest first
- 2024Consistency Models Made Easy20 Jun
- 2024Diffusion Models Are Innate One-Step Generators31 May
- 2024Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillation8 May
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation5 Apr
- 2024Tackling the Singularities at the Endpoints of Time Intervals in Diffusion Models13 Mar
- 2024Improving Diffusion-Based Generative Models via Approximated Optimal Transport8 Mar
- 2024On the Asymptotic Mean Square Error Optimality of Diffusion Models5 Mar
- 2024Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding29 Feb
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations23 Jan
- 2024Efficient generative adversarial networks using linear additive-attention Transformers17 Jan
- 2024A Good Score Does not Lead to A Good Generative Model10 Jan
- 2023Formulating Discrete Probability Flow Through Optimal Transport7 Nov
28 more
- 2023Exploiting the Signal-Leak Bias in Diffusion Models27 Sep
- 2023Diffusion Models with Deterministic Normalizing Flow Priors3 Sep
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2023DPM-OT: A New Diffusion Probabilistic Model Based on Optimal Transport21 Jul
- 2023Lipschitz Singularities in Diffusion Models20 Jun
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawed15 May
- 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models25 Apr
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
- 2023Input Perturbation Reduces Exposure Bias in Diffusion Models27 Jan
- 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance13 Dec
- 2022Wavelet Diffusion Models are fast and scalable Image Generators29 Nov
- 2022GENIE: Higher-Order Denoising Diffusion Solvers11 Oct
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations14 Jul
- 2022How Much is Enough? A Study on Diffusion Times in Score-based Generative Models10 Jun
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Accelerating Diffusion Models via Early Stop of the Diffusion Process25 May
- 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
- 2022Understanding DDPM Latent Codes Through Optimal Transport14 Feb
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANs15 Dec
- 2021Score-based Generative Modeling in Latent Space10 Jun
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
- 2020Improved Techniques for Training Score-Based Generative Models16 Jun
Other references · 36
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
24 more
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 307
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
- 2021Projected GANs Converge Fastercited by 208
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2023Flow Matching in Latent Spacecited by 160
- 2021ViTGAN: Training GANs with Vision Transformerscited by 110
- 2021An Introduction to Deep Generative Modelingcited by 104
- 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 95
- 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 86
- 2021PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Priorcited by 80
- 2017A Geometric View of Optimal Transportation and Generative Modelcited by 31
- 2021Styleformer: Transformer based Generative Adversarial Networks with Style Vectorcited by 27
- 2019Quantitative stability of optimal transport maps and linearization of the 2-Wasserstein spacecited by 25
- 2024The Crystal Ball Hypothesis in diffusion models: Anticipating object positions from initial noisecited by 19
- 2024Optimizing Diffusion Models for Joint Trajectory Prediction and Controllable Generationcited by 18
- 2023InstaStyle: Inversion Noise of a Stylized Image is Secretly a Style Advisercited by 17
- 2015A Computational Framework for Multivariate Convex Regression and its Variantscited by 16
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layercited by 14
- 2020AE-OT-GAN: Training GANs from data specific latent distributioncited by 13
- 2021Convex Smoothed Autoencoder-Optimal Transport modelcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Diagnosing and Improving Diffusion Models by Estimating the Optimal Loss Value
- 2023The Missing U for Efficient Diffusion Models
- 2023On Error Propagation of Diffusion Models
- 2022An optimal control perspective on diffusion-based generative modeling
- 2025Diffusion Models: A Mathematical Introduction
- 2026A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models
- 2025Pretrained Diffusion Models Are Inherently Skipped-Step Samplers