mlsanityData to 14 Oct 2026

Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows

arXiv 2503.09069 ↗First posted 12 Mar 2025cs.LG cs.AI cs.CVcited by 10

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Flow matching has emerged as a powerful framework for generative modeling, offering computational advantages over diffusion models by leveraging deterministic Ordinary Differential Equations (ODEs) instead of stochastic dynamics. While prior work established the worst case optimality of standard flow matching under Wasserstein distances, the theoretical guarantees for higher-order flow matching - which incorporates acceleration terms to refine sample trajectories - remain unexplored. In this paper, we bridge this gap by proving that higher-order flow matching preserves worst case optimality as a distribution estimator. We derive upper bounds on the estimation error for second-order flow matching, demonstrating that the convergence rates depend polynomially on the smoothness of the target distribution (quantified via Besov spaces) and key parameters of the ODE dynamics. Our analysis employs neural network approximations with carefully controlled depth, width, and sparsity to bound acceleration errors across both small and large time intervals, ultimately unifying these results into a general worst case optimal bound for all time steps.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 101 of its 138 references that are in the map. First posted on arXiv 12 Mar 2025.

Builds on

101 of 138 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025High-Order Matching for One-Step Shortcut Diffusion Models2 Feb
  2. 2024Flow matching achieves almost minimax optimal convergence31 May
  3. 2024Extended Flow Matching: a Method of Conditional Generation with Generalized Continuity Equation29 Feb
  4. 2023Flow Matching for Scalable Simulation-Based Inference26 May
  5. 2023Flow Matching on General Geometries7 Feb
  6. 2022Flow Matching for Generative Modeling6 Oct
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 94

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  11. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  12. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
38 more
  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  3. 2015Variational Inference with Normalizing Flowscited by 2,170
  4. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  5. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
  6. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  7. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
  8. 2023LIMA: Less Is More for Alignmentcited by 1,100
  9. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  10. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
  11. 2022Transformers learn in-context by gradient descentcited by 732
  12. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
  13. 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
  14. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  15. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
  16. 2024One Step Diffusion via Shortcut Modelscited by 391
  17. 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
  18. 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 256
  19. 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
  20. 2023Diffusion Models are Minimax Optimal Distribution Estimatorscited by 165
  21. 2023Representational Strengths and Limitations of Transformerscited by 133
  22. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Modelscited by 113
  23. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 100
  24. 2020Learning Differential Equations that are Easy to Solvecited by 81
  25. 2023Symbol tuning improves in-context learning in language modelscited by 75
  26. 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
  27. 2024Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptionscited by 47
  28. 2023Iterative α-(de)Blending: a Minimalist Deterministic Diffusion Modelcited by 46
  29. 2023An Over-parameterized Exponential Regressioncited by 45
  30. 2024Why Larger Language Models Do In-context Learning Differently?cited by 45
  31. 2023How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computationcited by 44
  32. 2024On Computational Limits of Modern Hopfield Models: A Fine-Grained Complexity Analysiscited by 41
  33. 2024On Statistical Rates and Provably Efficient Criteria of Latent Diffusion Transformers (DiTs)cited by 40
  34. 2024Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalabilitycited by 40
  35. 2024Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reductioncited by 39
  36. 2024Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Modelscited by 38
  37. 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 37
  38. 2023STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Predictioncited by 35

50 most cited of 94 All 94 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 2.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Generative Modeling with Continuous Flows: Sample Complexity of Flow Matching
  2. 2026From Euler to Dormand-Prince: ODE Solvers for Flow Matching Generative Models
  3. 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Step
  4. 2024Convergence Analysis of Flow Matching in Latent Space with Transformers
  5. 2025A Theoretical Analysis of Discrete Flow Matching Generative Models
  6. 2026Path-independent Flow Matching for Multi-parameter Generative Dynamics
  7. 2026ODE-free Neural Flow Matching for One-Step Generative Modeling
  8. 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees