mlsanityData to 14 Oct 2026

Generalization and Memorization in Rectified Flow

arXiv 2603.13421 ↗First posted 12 Mar 2026cs.LG cs.CVcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Generative models based on the Flow Matching objective, particularly Rectified Flow, have emerged as a dominant paradigm for efficient, high-fidelity image synthesis. However, while existing research heavily prioritizes generation quality and architectural scaling, the underlying dynamics of how RF models memorize training data remain largely underexplored. In this paper, we systematically investigate the memorization behaviors of RF through the test statistics of Membership Inference Attacks (MIA). We progressively formulate three test statistics, culminating in a complexity-calibrated metric that successfully decouples intrinsic image spatial complexity from genuine memorization signals. This calibration yields a significant performance surge -- boosting attack AUC by up to 15% and the privacy-critical TPR@1%FPR metric by up to 45% -- establishing the first non-trivial MIA specifically tailored for RF. Leveraging these refined metrics, we uncover a distinct temporal pattern: under standard uniform temporal training, a model's susceptibility to MIA strictly peaks at the integration midpoint, a phenomenon we justify via the network's forced deviation from linear approximations. Finally, we demonstrate that substituting uniform timestep sampling with a Symmetric Exponential (U-shaped) distribution effectively minimizes exposure to vulnerable intermediate timesteps. Extensive evaluations across three datasets confirm that this temporal regularization suppresses memorization while preserving generative fidelity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 40 of its 53 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

40 of 53 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Flow Matching Guide and Code9 Dec
  2. 2024Improving the Training of Rectified Flows30 May
  3. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplings28 Apr
  4. 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
  5. 2022Flow Matching for Generative Modeling6 Oct
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 34

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  7. 2016Deep Learning with Differential Privacycited by 2,728
  8. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  11. 2021Membership Inference Attacks From First Principlescited by 878
  12. 2016Pixel Recurrent Neural Networkscited by 816
22 more
  1. 2023Extracting Training Data from Diffusion Modelscited by 732
  2. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  3. 2018Do Deep Generative Models Know What They Don't Know?cited by 443
  4. 2020Differentially Private Learning Needs Better Features (or Much More Data)cited by 235
  5. 2019Input complexity and out-of-distribution detection with likelihood-based generative modelscited by 186
  6. 2023Generalization in diffusion models arises from geometry-adaptive harmonic representationscited by 185
  7. 2023Are Diffusion Models Vulnerable to Membership Inference Attacks?cited by 136
  8. 2023On Memorization in Diffusion Modelscited by 125
  9. 2022Diffusion Probabilistic Model Made Slimcited by 121
  10. 2022Differentially Private Diffusion Modelscited by 119
  11. 2025Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Trainingcited by 81
  12. 2023On the Generalization Properties of Diffusion Modelscited by 68
  13. 2021On Memorization in Probabilistic Deep Generative Modelscited by 60
  14. 2023An Efficient Membership Inference Attack for the Diffusion Model by Proximal Initializationcited by 54
  15. 2024Membership Inference on Text-to-Image Diffusion Models via Conditional Likelihood Discrepancycited by 38
  16. 2024Understanding Generalizability of Diffusion Models Requires Rethinking the Hidden Gaussian Structurecited by 38
  17. 2025Locality in Image Diffusion Models Emerges from Data Statisticscited by 25
  18. 2023A Probabilistic Fluctuation based Membership Inference Attack for Diffusion Modelscited by 18
  19. 2023Likelihood-based Out-of-Distribution Detection with Denoising Diffusion Probabilistic Modelscited by 10
  20. 2021Generalization Error of GAN from the Discriminator's Perspectivecited by 8
  21. 2025Score-based Membership Inference on Diffusion Modelscited by 3
  22. 2025Latent Diffusion Inversion Requires Understanding the Latent Spacecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Where Flow Matching Leaks: Characterising Membership Signals Along the Interpolation Path
  2. 2026The Geometry of Memorization: Finite-Time Spectral Sensitivity as a Diagnostic for Flow Matching Models
  3. 2026Signed Rectified Flow: Negativity-Controlled Generation
  4. 2025Gradient Variance Reveals Failure Modes in Flow-Based Generative Models
  5. 2025Efficiency vs. Fidelity: A Comparative Analysis of Diffusion Probabilistic Models and Flow Matching on Low-Resource Hardware
  6. 2024LoyalDiffusion: A Diffusion Model Guarding Against Data Replication
  7. 2025From Navigation to Refinement: Revealing the Two-Stage Nature of Flow-based Diffusion Models through Oracle Velocity
  8. 2026FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference