mlsanityData to 7 Oct 2026

Constant Acceleration Flow

arXiv 2411.00322 ↗First posted 1 Nov 2024cs.LG cs.AI cs.CVcited by 11

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Rectified flow and reflow procedures have significantly advanced fast generation by progressively straightening ordinary differential equation (ODE) flows. They operate under the assumption that image and noise pairs, known as couplings, can be approximated by straight trajectories with constant velocity. However, we observe that modeling with constant velocity and using reflow procedures have limitations in accurately learning straight trajectories between pairs, resulting in suboptimal performance in few-step generation. To address these limitations, we introduce Constant Acceleration Flow (CAF), a novel framework based on a simple constant acceleration equation. CAF introduces acceleration as an additional learnable variable, allowing for more expressive and accurate estimation of the ODE flow. Moreover, we propose two techniques to further improve estimation accuracy: initial velocity conditioning for the acceleration model and a reflow process for the initial velocity. Our comprehensive studies on toy datasets, CIFAR-10, and ImageNet 64x64 demonstrate that CAF outperforms state-of-the-art baselines for one-step generation. We also show that CAF dramatically improves few-step coupling preservation and inversion over Rectified flow. Code is available at hrefhttps://github.com/mlvlab/CAFhttps://github.com/mlvlab/CAF.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 48 of its 57 references that are in the map. First posted on arXiv 1 Nov 2024.

Builds on

48 of 57 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Improving the Training of Rectified Flows30 May
  2. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation12 Sep
  3. 2022Flow Matching for Generative Modeling6 Oct
  4. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transport29 Sep
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 43

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
31 more
  1. 2016Improved Techniques for Training GANscited by 2,938
  2. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  3. 2016Density estimation using Real NVPcited by 2,029
  4. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  5. 2023Consistency Modelscited by 1,778
  6. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  8. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  10. 2021Variational Diffusion Modelscited by 1,145
  11. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  12. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  13. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  14. 2022On Distillation of Guided Diffusion Modelscited by 721
  15. 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
  16. 2021Score-based Generative Modeling in Latent Spacecited by 634
  17. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 526
  18. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  19. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
  20. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  21. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
  22. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 243
  23. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
  24. 2022Fast Sampling of Diffusion Models via Operator Learningcited by 173
  25. 2020OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transportcited by 143
  26. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 115
  27. 2023Generative Modeling with Phase Stochastic Bridgescited by 24
  28. 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representationscited by 16
  29. 2024Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problemscited by 13
  30. 2024Stochastic Conditional Diffusion Models for Robust Semantic Image Synthesiscited by 10
  31. 2023NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistencycited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 3.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Balanced conic rectified flow
  2. 2025OAT-FM: Optimal Acceleration Transport for Improved Flow Matching
  3. 2026The Velocity Deficit: Initial Energy Injection for Flow Matching
  4. 2026Accelerating Rectified Flow Models via Trajectory-Aware Caching
  5. 2026VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation
  6. 2026Smoother Flow Matching via Contrastive Trajectory Repulsion
  7. 2025Flow Diverse and Efficient: Learning Momentum Flow Matching via Stochastic Velocity Field Sampling
  8. 2026VTV-FM: Flow Matching through Variational Terminal-Velocity Closure