Adaptive Diffusion Guidance via Stochastic Optimal Control
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approaches to guidance scheduling--determining the appropriate guidance weight--are largely heuristic and lack a solid theoretical foundation. This work addresses these limitations on two fronts. First, we provide a theoretical formalization that precisely characterizes the relationship between guidance strength and classifier confidence. Second, building on this insight, we introduce a stochastic optimal control framework that casts guidance scheduling as an adaptive optimization problem. In this formulation, guidance strength is not fixed but dynamically selected based on time, the current sample, and the conditioning class, either independently or in combination. By solving the resulting control problem, we establish a principled foundation for more effective guidance in diffusion models.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 30 of its 39 references that are in the map. First posted on arXiv 25 May 2025.
Builds on
30 of 39 references.
Closest ancestors · 17
Same direction, newest first
- 2025Provable Efficiency of Guidance in Diffusion Models for General Data Distribution2 May
- 2025Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts4 Mar
- 2024Simple Guidance Mechanisms for Discrete Diffusion Models13 Dec
- 2024What does guidance do? A fine-grained analysis in a simple setting19 Sep
- 2024Classifier-Free Guidance is a Predictor-Corrector16 Aug
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Models11 Apr
- 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance8 Apr
- 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models29 Feb
- 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
- 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer25 Mar
- 2022Classifier-Free Diffusion Guidance26 Jul
5 more
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 13
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 222
- 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 213
1 more
- 2022Equivariant Energy-Guided SDE for Inverse Molecular Designcited by 72
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2025Learn to Guide Your Diffusion Modelcited by 12
- 2026Inference-Time Attribute Distribution Alignment for Unconditional Diffusioncited by 2
- 2026Stay Fair! Ensuring Group Fairness in Diffusion Models Across Guidance Scalescited by 2
- 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Modelscited by 1
- 2026Learning To Sample From Diffusion Models Via Inverse Reinforcement Learningcited by 0
- 2026Guidance Is Not a Hyperparameter: Learning Dynamic Control in Diffusion Language Modelscited by 0
- 2026Variational Test-time Optimization for Diffusion Synchronizationcited by 0
- 2026Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusioncited by 0
- 2026Classifier-Free Guidance in Flow Matching: Non-Autonomous Potentials, Overshoot, and Posterior-Mean Controlcited by 0
- 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Models28 Sep 2026
- 2026Classifier-Free Guidance in Flow Matching: Non-Autonomous Potentials, Overshoot, and Posterior-Mean Control21 Sep 2026
- 2026Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion30 Aug 2026
- 2026Variational Test-time Optimization for Diffusion Synchronization14 Jun 2026
- 2026Stay Fair! Ensuring Group Fairness in Diffusion Models Across Guidance Scales27 May 2026
- 2026Guidance Is Not a Hyperparameter: Learning Dynamic Control in Diffusion Language Models8 May 2026
- 2026Inference-Time Attribute Distribution Alignment for Unconditional Diffusion8 May 2026
- 2026Learning To Sample From Diffusion Models Via Inverse Reinforcement Learning9 Feb 2026
- 2025Learn to Guide Your Diffusion Model1 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Models
- 2024Gradient Guidance for Diffusion Models: An Optimization Perspective
- 2026C2FG: Control Classifier-Free Guidance via Score Discrepancy Analysis
- 2025Feedback Guidance of Diffusion Models
- 2025Stage-wise Dynamics of Classifier-Free Guidance in Diffusion Models
- 2023Bridging the Gap: Addressing Discrepancies in Diffusion Model Training for Classifier-Free Guidance
- 2025Towards a unified framework for guided diffusion models
- 2023Elucidating The Design Space of Classifier-Guided Diffusion Generation