mlsanityData to 14 Oct 2026

Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching

arXiv 2606.28226 ↗First posted 26 Jun 2026cs.CV cs.AIcited by 4

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Flow Matching (FM) has achieved remarkable generative performance, yet it suffers from exposure bias due to discrepancies between training and inference. Existing mitigation strategies typically rely on static constraints or external heuristics. In this work, we propose that exposure bias itself inherently contains dynamic signals that can guide its own rectification. To leverage this, we introduce DEFAR (DirEctional-Frequency Adaptive Rectification). This framework simulates the single-step inference process during training to identify exposure bias. It utilizes directional and frequency-adaptive feedback signals from the bias itself to enhance the model's bias tolerance. It consists of two key components: (1) Anti-Drift Rectification (ADR). ADR treats inference-time drift as a signal to learn the direction to steer deviated states back toward the target. ADR endows the model with intrinsic active self-rectification capabilities; (2) Frequency Compensation (FC). Empirically, we observe that accumulated bias often stems from a lack of low-frequency components in high-noise stages, and exposure bias carries the missing frequency. FC leverages the bias itself as a self-feedback weighting factor to reinforce the missing frequency components. Experiments on CIFAR-10, CelebA-64, and ImageNet-256/512 show that DEFAR outperforms prior baselines and further demonstrates favorable scalability, compatibility, and inference robustness.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 61 of its 75 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

61 of 75 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025CurveFlow: Curvature-Guided Flow Matching for Image Generation20 Aug
  2. 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling22 Jul
  3. 2025Improving Progressive Generation with Decomposable Flow Matching24 Jun
  4. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillation17 Jun
  5. 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
  6. 2022Flow Matching for Generative Modeling6 Oct
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 54

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  9. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  10. 2016Improved Techniques for Training GANscited by 2,970
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2023Consistency Modelscited by 1,822
38 more
  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  2. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  3. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  4. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
  5. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  6. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  7. 2015Sequence Level Training with Recurrent Neural Networkscited by 576
  8. 2025Mean Flows for One-step Generative Modelingcited by 561
  9. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  10. 2024One Step Diffusion via Shortcut Modelscited by 391
  11. 2021Generating Images with Sparse Representationscited by 266
  12. 2025Kimi-Audio Technical Reportcited by 222
  13. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  14. 2022Rethinking Graph Neural Networks for Anomaly Detectioncited by 187
  15. 2020On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translationcited by 127
  16. 2019Bridging the Gap between Training and Inference for Neural Machine Translationcited by 123
  17. 2019Generalization in Generation: A closer look at Exposure Biascited by 123
  18. 2025DDT: Decoupled Diffusion Transformercited by 109
  19. 2023Elucidating the Exposure Bias in Diffusion Modelscited by 101
  20. 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Modelscited by 100
  21. 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 95
  22. 2023Input Perturbation Reduces Exposure Bias in Diffusion Modelscited by 90
  23. 2025LongCat-Video Technical Reportcited by 85
  24. 2023Alleviating Exposure Bias in Diffusion Models through Sampling with Shifted Time Stepscited by 73
  25. 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistentcited by 58
  26. 2023PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Modelcited by 58
  27. 2024Video-Guided Foley Sound Generation with Multimodal Controlscited by 49
  28. 2023Exploiting the Signal-Leak Bias in Diffusion Modelscited by 36
  29. 2023On Error Propagation of Diffusion Modelscited by 31
  30. 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Modelcited by 28
  31. 2025Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoningcited by 17
  32. 2025COSMIC: Clique-Oriented Semantic Multi-space Integration for Robust CLIP Test-Time Adaptationcited by 13
  33. 2024MotiF: Making Text Count in Image Animation with Motion Focal Losscited by 10
  34. 2025Model Already Knows the Best Noise: Bayesian Active Noise Selection via Attention in Video Diffusion Modelcited by 10
  35. 2022Markup-to-Image Diffusion Models with Scheduled Samplingcited by 6
  36. 2025Proteus-ID: ID-Consistent and Motion-Coherent Video Customizationcited by 6
  37. 2025Frequency Regulation for Exposure Bias Mitigation in Diffusion Modelscited by 6
  38. 2025A High-Dimensional Statistical Method for Optimizing Transfer Quantities in Multi-Source Transfer Learningcited by 5

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReflexFlow: Rethinking Learning Objective for Exposure Bias Alleviation in Flow Matching
  2. 2026Smoother Flow Matching via Contrastive Trajectory Repulsion
  3. 2026FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference
  4. 2024Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching
  5. 2026Posterior Augmented Flow Matching
  6. 2026Training-Free Refinement of Flow Matching with Divergence-based Sampling
  7. 2026Exploring and Exploiting Stability in Latent Flow Matching
  8. 2026Frequency-Aware Flow Matching for High-Quality Image Generation