mlsanityData to 14 Oct 2026

Radial Tail Repair: Post-Training Correction for Diffusion and Flow Models

arXiv 2610.16851 ↗First posted 12 Oct 2026cs.LG stat.MLcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Diffusion and flow-matching models may struggle to accurately represent distributional tails, especially for heavy-tailed data. Existing approaches often use heavy-tailed noise or modify the generative dynamics, requiring dedicated retraining and more difficult estimation. We take a simpler approach: rather than relearning the full distribution, we correct only the model's behavior in the extreme regime. Our method builds on the radial-angular decomposition of multivariate heavy tails, where radius and direction become asymptotically independent. This allows us to preserve the directional structure learned by the pretrained model and correct only its radial tail. We estimate the tail onset from reference and generated samples, then rescale generated extremes so that their radial survival matches the target distribution. The resulting method is a lightweight post-training correction applied to a frozen diffusion or flow-matching model, requiring neither retraining nor changes to its sampling dynamics. Experiments on challenging synthetic heavy-tailed distributions and real weather and wildfire datasets show that this simple correction substantially improves extreme-tail coverage using only a small number of fitting samples.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 41 of its 65 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

41 of 65 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalities7 Apr
  2. 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching16 Apr
  3. 2023Practical and Asymptotically Exact Conditional Sampling in Diffusion Models30 Jun
  4. 2022Flow Matching for Generative Modeling6 Oct
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  6. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  7. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  8. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 450
  9. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  10. 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 233
  11. 2019Quant GANs: Deep Generation of Financial Time Seriescited by 108
  12. 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Modelscited by 100
24 more
  1. 2025Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Expertscited by 96
  2. 2018Discriminator Rejection Samplingcited by 49
  3. 2022Probability flow solution of the Fokker-Planck equationcited by 47
  4. 2018Metropolis-Hastings Generative Adversarial Networkscited by 41
  5. 2024Heavy-Tailed Diffusion Modelscited by 40
  6. 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distancecited by 29
  7. 2024Implicit Diffusion: Efficient Optimization through Stochastic Samplingcited by 24
  8. 2021Pareto GAN: Extending the Representational Power of GANs to Heavy-Tailed Distributionscited by 23
  9. 2024Flexible Tails for Normalizing Flowscited by 12
  10. 2022Fat-Tailed Variational Inference with Anisotropic Tail Adaptive Flowscited by 11
  11. 2023A VAE Approach to Sample Multivariate Extremescited by 10
  12. 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Boundscited by 9
  13. 2021Modeling Extremes with d-max-decreasing Neural Networkscited by 5
  14. 2025Generative modelling with jump-diffusionscited by 5
  15. 2026Inference-Time Alignment for Diffusion Models via Variationally Stable Doob's Matchingcited by 5
  16. 2026On Forgetting and Stability of Score-based Generative modelscited by 5
  17. 2026Alignment of Diffusion Model and Flow Matching for Text-to-Image Generationcited by 3
  18. 2026Generalizing Score-based generative models for Heavy-tailed Distributionscited by 3
  19. 2026Do Heavy Tails Help Diffusion? On the Subtle Trade-off Between Initialization and Trainingcited by 3
  20. 2026Non-Asymptotic Error Bounds for SMC with Biased Proposals: Application to Conditional Diffusion Samplingcited by 2
  21. 2026Self-Regulating Annealing in Heavy-Tailed Diffusion Modelscited by 1
  22. 2026The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RLcited by 1
  23. 2026DOHF: Online Diffusion Fine-tuning with Doob's h-transform Guidancecited by 1
  24. 2026WEIRDO: WEak resIdual Regularized DOob's h-transform diffusion alignmentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Tail Annealing for Heavy-Tailed Flow Matching
  2. 2026Heavy-Tailed Flow Matching via Random Clocks
  3. 2024Conditional diffusion models for downscaling and bias correction of Earth system model precipitation
  4. 2023Debias Coarsely, Sample Conditionally: Statistical Downscaling through Optimal Transport and Probabilistic Diffusion Models
  5. 2024TAUDiff: Highly efficient kilometer-scale downscaling using generative diffusion models
  6. 2024Heavy-Tailed Diffusion with Denoising L'evy Probabilistic Models
  7. 2026Diffusion Models with Heavy-Tailed Targets: Score Estimation and Sampling Guarantees
  8. 2025Fine-Tuning Flow Matching via Maximum Likelihood Estimation of Reconstructions