Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Flow Matching (FM) has achieved remarkable generative performance, yet it suffers from exposure bias due to discrepancies between training and inference. Existing mitigation strategies typically rely on static constraints or external heuristics. In this work, we propose that exposure bias itself inherently contains dynamic signals that can guide its own rectification. To leverage this, we introduce DEFAR (DirEctional-Frequency Adaptive Rectification). This framework simulates the single-step inference process during training to identify exposure bias. It utilizes directional and frequency-adaptive feedback signals from the bias itself to enhance the model's bias tolerance. It consists of two key components: (1) Anti-Drift Rectification (ADR). ADR treats inference-time drift as a signal to learn the direction to steer deviated states back toward the target. ADR endows the model with intrinsic active self-rectification capabilities; (2) Frequency Compensation (FC). Empirically, we observe that accumulated bias often stems from a lack of low-frequency components in high-noise stages, and exposure bias carries the missing frequency. FC leverages the bias itself as a self-feedback weighting factor to reinforce the missing frequency components. Experiments on CIFAR-10, CelebA-64, and ImageNet-256/512 show that DEFAR outperforms prior baselines and further demonstrates favorable scalability, compatibility, and inference robustness.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 61 of its 75 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
61 of 75 references.
Closest ancestors · 7
Same direction, newest first
- 2025CurveFlow: Curvature-Guided Flow Matching for Image Generation20 Aug
- 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling22 Jul
- 2025Improving Progressive Generation with Decomposable Flow Matching24 Jun
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillation17 Jun
- 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 54
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2016Improved Techniques for Training GANscited by 2,970
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Consistency Modelscited by 1,822
38 more
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2015Sequence Level Training with Recurrent Neural Networkscited by 576
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2021Generating Images with Sparse Representationscited by 266
- 2025Kimi-Audio Technical Reportcited by 222
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2022Rethinking Graph Neural Networks for Anomaly Detectioncited by 187
- 2020On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translationcited by 127
- 2019Bridging the Gap between Training and Inference for Neural Machine Translationcited by 123
- 2019Generalization in Generation: A closer look at Exposure Biascited by 123
- 2025DDT: Decoupled Diffusion Transformercited by 109
- 2023Elucidating the Exposure Bias in Diffusion Modelscited by 101
- 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Modelscited by 100
- 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 95
- 2023Input Perturbation Reduces Exposure Bias in Diffusion Modelscited by 90
- 2025LongCat-Video Technical Reportcited by 85
- 2023Alleviating Exposure Bias in Diffusion Models through Sampling with Shifted Time Stepscited by 73
- 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistentcited by 58
- 2023PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Modelcited by 58
- 2024Video-Guided Foley Sound Generation with Multimodal Controlscited by 49
- 2023Exploiting the Signal-Leak Bias in Diffusion Modelscited by 36
- 2023On Error Propagation of Diffusion Modelscited by 31
- 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Modelcited by 28
- 2025Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoningcited by 17
- 2025COSMIC: Clique-Oriented Semantic Multi-space Integration for Robust CLIP Test-Time Adaptationcited by 13
- 2024MotiF: Making Text Count in Image Animation with Motion Focal Losscited by 10
- 2025Model Already Knows the Best Noise: Bayesian Active Noise Selection via Attention in Video Diffusion Modelcited by 10
- 2022Markup-to-Image Diffusion Models with Scheduled Samplingcited by 6
- 2025Proteus-ID: ID-Consistent and Motion-Coherent Video Customizationcited by 6
- 2025Frequency Regulation for Exposure Bias Mitigation in Diffusion Modelscited by 6
- 2025A High-Dimensional Statistical Method for Optimizing Transfer Quantities in Multi-Source Transfer Learningcited by 5
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 3
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoisingcited by 1
- 2026ReCurveflow: A Flow Matching Framework that Learns Curved Reaction Trajectories to Predict Transition State Geometriescited by 0
- 2026Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generationcited by 0
- 2026Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generation30 Aug 2026
- 2026ReCurveflow: A Flow Matching Framework that Learns Curved Reaction Trajectories to Predict Transition State Geometries21 Aug 2026
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning2 Jul 2026
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising29 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025ReflexFlow: Rethinking Learning Objective for Exposure Bias Alleviation in Flow Matching
- 2026Smoother Flow Matching via Contrastive Trajectory Repulsion
- 2026FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference
- 2024Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching
- 2026Posterior Augmented Flow Matching
- 2026Training-Free Refinement of Flow Matching with Divergence-based Sampling
- 2026Exploring and Exploiting Stability in Latent Flow Matching
- 2026Frequency-Aware Flow Matching for High-Quality Image Generation