Input-Adaptive Generative Dynamics in Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models typically generate data through a fixed denoising trajectory that is shared across all samples. However, generation targets can differ in complexity, suggesting that a single pre-defined diffusion process may not be optimal for every input. In this work, we investigate input-adaptive generative dynamics for diffusion models, where the generation process itself adapts to the conditions of each sample. Instead of relying on a fixed diffusion trajectory, the proposed framework allows the generative dynamics to adjust across inputs according to their generation requirements. To enable this behavior, we train the diffusion backbone under varying horizons and noise schedules, so that it can operate consistently under different input-adaptive trajectories. Experiments on conditional image generation show that diffusion trajectories can vary across inputs while maintaining generation quality and reducing the average number of sampling steps. These results provide a proof of the concept that diffusion processes can benefit from input-adaptive generative dynamics rather than relying on a single fixed trajectory.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 42 of its 47 references that are in the map. First posted on arXiv 19 Nov 2024.
Builds on
42 of 47 references.
Closest ancestors · 25
Same direction, newest first
- 2024Consistency Models Made Easy20 Jun
- 2023AdaDiff: Accelerating Diffusion Models through Step-Wise Adaptive Computation29 Sep
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model17 Mar
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels21 Feb
- 2023ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectories5 Feb
- 2022On Distillation of Guided Diffusion Models6 Oct
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2022gDDIM: Generalized denoising diffusion implicit models11 Jun
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
- 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
13 more
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesis29 Nov
- 2021Conditional Image Generation with Score-Based Diffusion Models26 Nov
- 2021Learning to Efficiently Sample from Diffusion Probabilistic Models7 Jun
- 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Noise Estimation for Generative Diffusion Models6 Apr
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed7 Jan
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 212
5 more
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 200
- 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
- 2022Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Trainingcited by 56
- 2022UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidancecited by 30
- 2016Reflections on Shannon Information: In search of a natural information-entropy for imagescited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024On the Trajectory Regularity of ODE-based Diffusion Sampling
- 2025Beyond Fixed Horizons: A Theoretical Framework for Adaptive Denoising Diffusions
- 2024Tracing the Roots: Leveraging Temporal Dynamics in Diffusion Trajectories for Origin Attribution
- 2022Dynamic Dual-Output Diffusion Models
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models
- 2025Geometric Regularity in Deterministic Sampling Dynamics of Diffusion-based Generative Models
- 2023Nested Diffusion Processes for Anytime Image Generation
- 2024GUD: Generation with Unified Diffusion