mlsanityData to 7 Oct 2026

Learning Quantized Adaptive Conditions for Diffusion Models

arXiv 2409.17487 ↗First posted 26 Sep 2024cs.CVcited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

The curvature of ODE trajectories in diffusion models hinders their ability to generate high-quality images in a few number of function evaluations (NFE). In this paper, we propose a novel and effective approach to reduce trajectory curvature by utilizing adaptive conditions. By employing a extremely light-weight quantized encoder, our method incurs only an additional 1% of training parameters, eliminates the need for extra regularization terms, yet achieves significantly better sample quality. Our approach accelerates ODE sampling while preserving the downstream task image editing capabilities of SDE techniques. Extensive experiments verify that our method can generate high quality results under extremely limited sampling costs. With only 6 NFE, we achieve 5.14 FID on CIFAR-10, 6.91 FID on FFHQ 64x64 and 3.10 FID on AFHQv2.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 41 of its 49 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

41 of 49 references.

Closest ancestors · 24

Same direction, newest first

  1. 2023Fast ODE-based Sampling for Diffusion Models in Around 5 Steps30 Nov
  2. 2023One-step Diffusion with Distribution Matching Distillation30 Nov
  3. 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics20 Oct
  4. 2023SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Models10 Sep
  5. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models29 May
  6. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillation7 Mar
  7. 2023Consistency Models2 Mar
  8. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
  9. 2023Minimizing Trajectory Curvature of ODE-based Generative Models27 Jan
  10. 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance13 Dec
  11. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  12. 2022GENIE: Higher-Order Denoising Diffusion Solvers11 Oct
12 more
  1. 2022Classifier-Free Diffusion Guidance26 Jul
  2. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  4. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  5. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
  6. 2021Variational Diffusion Models1 Jul
  7. 2021Score-based Generative Modeling in Latent Space10 Jun
  8. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  9. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed7 Jan
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Implicit Models6 Oct
  12. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 17

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  9. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  10. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  11. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  12. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
5 more
  1. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 267
  2. 2020Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimationcited by 87
  3. 2021Exponential Moving Average Normalization for Self-supervised and Semi-supervised Learningcited by 78
  4. 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
  5. 2023Catch-Up Distillation: You Only Need to Train Once for Accelerating Samplingcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026MixFlow: Mixed Source Distributions Improve Rectified Flowscited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2025Sampling-Aware Quantization for Diffusion Models
  2. 2024On the Trajectory Regularity of ODE-based Diffusion Sampling
  3. 2026A Plug-in Interpretation of Conditioning in Score-Based Diffusion Models
  4. 2023Towards Accurate Post-training Quantization for Diffusion Models
  5. 2024PQD: Post-training Quantization for Efficient Diffusion Models
  6. 2024Qua2SeDiMo: Quantifiable Quantization Sensitivity of Diffusion Models
  7. 2024Input-Adaptive Generative Dynamics in Diffusion Models
  8. 2025Error Propagation Mechanisms and Compensation Strategies for Quantized Diffusion