Annealed L'evy Diffusion via Gaussian Surrogate Reverse Dynamics
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Gaussian diffusion models offer a practical framework for generative modeling. Denoising L'evy Probabilistic Models (DLPM) introduce heavy-tailed perturbations with a fixed tail index throughout denoising. We introduce Annealed L'evy Diffusion (ALD). ALD varies the stability index α(t) to combine heavy-tailed exploration with Gaussian refinement. Our marginal-first formulation represents stable noise as a scalar Gaussian scale mixture. This formulation enables standard Gaussian noise-prediction training with one additional scale input. We study two sampling processes. ALD-renoise estimates the clean sample and injects fresh marginal noise. ALD-posterior preserves dependence between successive states through an accumulated conditional variance and a Gaussian bridge update. Both samplers reuse the same trained predictor with different scalar inputs. We evaluate ALD on four 2D benchmarks and an imbalanced nine-mode mixture. We also examine training efficiency and the effects of prediction perturbations on clipped Holtsmark data. Additional experiments evaluate MNIST and CelebA64 generation and CIFAR-10LT augmentation. ALD preserves local geometry on the evaluated light-tailed and manifold-structured targets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 25 of its 45 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
25 of 45 references.
Closest ancestors · 14
Same direction, newest first
- 2026Diffusion Models with Heavy-Tailed Targets: Score Estimation and Sampling Guarantees10 Jan
- 2024Heavy-Tailed Diffusion Models18 Oct
- 2024Heavy-Tailed Diffusion with Denoising L'evy Probabilistic Models26 Jul
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
- 2023Diffusion models with location-scale noise12 Apr
- 2023On the Importance of Noise Scheduling for Diffusion Models26 Jan
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise19 Aug
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
2 more
Other references · 11
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2018Demystifying MMD GANscited by 1,293
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
- 2020Multiplicative noise and heavy tails in stochastic optimizationcited by 17
- 2026Do Heavy Tails Help Diffusion? On the Subtle Trade-off Between Initialization and Trainingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Diffusion Models: A Mathematical Introduction
- 2025EVODiff: Entropy-aware Variance Optimized Diffusion Inference
- 2023To smooth a cloud or to pin it down: Guarantees and Insights on Score Matching in Denoising Diffusion Models
- 2023The Missing U for Efficient Diffusion Models
- 2025Diffusion Models under Alternative Noise: Simplified Analysis and Sensitivity
- 2025Improving Diffusion Generative Models via Truncated Karhunen--Lo`eve Expansion
- 2026Robust Diffusion Models via Divergence-Induced Weighted Denoising
- 2026Self-Regulating Annealing in Heavy-Tailed Diffusion Models