Rethinking Refinement: Correcting Generative Bias without Noise Injection
Not on the map. Why?
Abstract (arXiv)
Generative models, including diffusion and flow-based models, often exhibit systematic biases that degrade sample quality, particularly in high-dimensional settings. We revisit refinement methods and show that effective bias correction can be achieved as a post-hoc procedure, without noise injection or multi-step resampling of the sampling process. We propose a flow-matching-based Bi-stage Flow Refinement (BFR) framework with two refinement strategies operating at different stages: latent space alignment for approximately invertible generators and data space refinement trained with lightweight augmentations. Unlike previous refiners that perturb sampling dynamics, BFR preserves the original ODE trajectory and applies deterministic corrections to generated samples. Experiments on MNIST, CIFAR-10, and FFHQ at 256x256 resolution demonstrate consistent improvements in fidelity and coverage; notably, starting from base samples with FID 3.95, latent space refinement achieves a state-of-the-art FID of 1.46 on MNIST using only a single additional function evaluation (1-NFE), while maintaining sample diversity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 56 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
39 of 56 references.
References · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016Improved Techniques for Training GANscited by 2,938
27 more
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
- 2024One Step Diffusion via Shortcut Modelscited by 373
- 2021Deblurring via Stochastic Refinementcited by 248
- 2015Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networkscited by 214
- 2017Parameter Space Noise for Explorationcited by 158
- 2023Flow Matching in Latent Spacecited by 155
- 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 147
- 2019Generalization in Generation: A closer look at Exposure Biascited by 123
- 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latentscited by 103
- 2023Elucidating the Exposure Bias in Diffusion Modelscited by 98
- 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 91
- 2023Input Perturbation Reduces Exposure Bias in Diffusion Modelscited by 88
- 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
- 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
- 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
- 2020Sliced Iterative Normalizing Flowscited by 37
- 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Modelscited by 35
- 2024All Seeds Are Not Equal: Enhancing Compositional Text-to-Image Generation with Reliable Random Seedscited by 31
- 2025STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesiscited by 31
- 2023Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolutioncited by 19
- 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancementcited by 14
- 2024Random Latent Exploration for Deep Reinforcement Learningcited by 6
- 2025SimFlow: Simplified and End-to-End Training of Latent Normalizing Flowscited by 6
- 2025Flow-Matching Based Refiner for Molecular Conformer Generationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Simple ReFlow: Improved Techniques for Fast Flow Models
- 2026One Pass Is Not Enough: Recursive Latent Refinement for Generative Models
- 2024Analyzing and Mitigating Model Collapse in Rectified Flow Models
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- 2026Posterior Refinement: Fast Language Generation via Any-Order Flow Maps
- 2026Flowing with Confidence
- 2023Restart Sampling for Improving Generative Processes
- 2026Reflective Flow Sampling Enhancement