mlsanityData to 7 Oct 2026

Rethinking Refinement: Correcting Generative Bias without Noise Injection

arXiv 2601.21182 ↗First posted 29 Jan 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative models, including diffusion and flow-based models, often exhibit systematic biases that degrade sample quality, particularly in high-dimensional settings. We revisit refinement methods and show that effective bias correction can be achieved as a post-hoc procedure, without noise injection or multi-step resampling of the sampling process. We propose a flow-matching-based Bi-stage Flow Refinement (BFR) framework with two refinement strategies operating at different stages: latent space alignment for approximately invertible generators and data space refinement trained with lightweight augmentations. Unlike previous refiners that perturb sampling dynamics, BFR preserves the original ODE trajectory and applies deterministic corrections to generated samples. Experiments on MNIST, CIFAR-10, and FFHQ at 256x256 resolution demonstrate consistent improvements in fidelity and coverage; notably, starting from base samples with FID 3.95, latent space refinement achieves a state-of-the-art FID of 1.46 on MNIST using only a single additional function evaluation (1-NFE), while maintaining sample diversity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 56 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

39 of 56 references.

References · 39

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2016Improved Techniques for Training GANscited by 2,938
27 more
  1. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  2. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  3. 2022Denoising Diffusion Restoration Modelscited by 951
  4. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
  5. 2024One Step Diffusion via Shortcut Modelscited by 373
  6. 2021Deblurring via Stochastic Refinementcited by 248
  7. 2015Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networkscited by 214
  8. 2017Parameter Space Noise for Explorationcited by 158
  9. 2023Flow Matching in Latent Spacecited by 155
  10. 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 147
  11. 2019Generalization in Generation: A closer look at Exposure Biascited by 123
  12. 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latentscited by 103
  13. 2023Elucidating the Exposure Bias in Diffusion Modelscited by 98
  14. 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 91
  15. 2023Input Perturbation Reduces Exposure Bias in Diffusion Modelscited by 88
  16. 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
  17. 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
  18. 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
  19. 2020Sliced Iterative Normalizing Flowscited by 37
  20. 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Modelscited by 35
  21. 2024All Seeds Are Not Equal: Enhancing Compositional Text-to-Image Generation with Reliable Random Seedscited by 31
  22. 2025STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesiscited by 31
  23. 2023Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolutioncited by 19
  24. 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancementcited by 14
  25. 2024Random Latent Exploration for Deep Reinforcement Learningcited by 6
  26. 2025SimFlow: Simplified and End-to-End Training of Latent Normalizing Flowscited by 6
  27. 2025Flow-Matching Based Refiner for Molecular Conformer Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Simple ReFlow: Improved Techniques for Fast Flow Models
  2. 2026One Pass Is Not Enough: Recursive Latent Refinement for Generative Models
  3. 2024Analyzing and Mitigating Model Collapse in Rectified Flow Models
  4. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
  5. 2026Posterior Refinement: Fast Language Generation via Any-Order Flow Maps
  6. 2026Flowing with Confidence
  7. 2023Restart Sampling for Improving Generative Processes
  8. 2026Reflective Flow Sampling Enhancement