mlsanityData to 7 Oct 2026

Adaptive Diffusion Guidance via Stochastic Optimal Control

arXiv 2505.19367 ↗First posted 25 May 2025stat.ML cs.LGcited by 9

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approaches to guidance scheduling--determining the appropriate guidance weight--are largely heuristic and lack a solid theoretical foundation. This work addresses these limitations on two fronts. First, we provide a theoretical formalization that precisely characterizes the relationship between guidance strength and classifier confidence. Second, building on this insight, we introduce a stochastic optimal control framework that casts guidance scheduling as an adaptive optimization problem. In this formulation, guidance strength is not fixed but dynamically selected based on time, the current sample, and the conditioning class, either independently or in combination. By solving the resulting control problem, we establish a principled foundation for more effective guidance in diffusion models.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 30 of its 39 references that are in the map. First posted on arXiv 25 May 2025.

Builds on

30 of 39 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025Provable Efficiency of Guidance in Diffusion Models for General Data Distribution2 May
  2. 2025Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts4 Mar
  3. 2024Simple Guidance Mechanisms for Discrete Diffusion Models13 Dec
  4. 2024What does guidance do? A fine-grained analysis in a simple setting19 Sep
  5. 2024Classifier-Free Guidance is a Predictor-Corrector16 Aug
  6. 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Models11 Apr
  7. 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance8 Apr
  8. 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models29 Feb
  9. 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  11. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer25 Mar
  12. 2022Classifier-Free Diffusion Guidance26 Jul
5 more
  1. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  3. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  5. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 13

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  7. 2022Video Diffusion Modelscited by 2,280
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  9. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
  10. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  11. 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 222
  12. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 213
1 more
  1. 2022Equivariant Energy-Guided SDE for Inverse Molecular Designcited by 72

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Models
  2. 2024Gradient Guidance for Diffusion Models: An Optimization Perspective
  3. 2026C2FG: Control Classifier-Free Guidance via Score Discrepancy Analysis
  4. 2025Feedback Guidance of Diffusion Models
  5. 2025Stage-wise Dynamics of Classifier-Free Guidance in Diffusion Models
  6. 2023Bridging the Gap: Addressing Discrepancies in Diffusion Model Training for Classifier-Free Guidance
  7. 2025Towards a unified framework for guided diffusion models
  8. 2023Elucidating The Design Space of Classifier-Guided Diffusion Generation