Fine-Tuning Flow Matching via Maximum Likelihood Estimation of Reconstructions
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Flow Matching (FM) models achieve remarkable results in generative tasks. Building upon diffusion models, FM's simulation-free training paradigm enables simplicity and efficiency but introduces a train-inference gap: model outputs cannot be assessed during training. Moreover, the straight flow assumption suffers from some inherent limitations. To address this, we propose to fine-tune FM via Maximum Likelihood Estimation (MLE) of reconstructions -- enabled by FM's smooth ODE formulation, unlike the stochastic differential equations (SDEs) in diffusion models. We first theoretically analyze the relationship between training loss and inference error in FM under numerical precision constraints. We then propose an easy-to-implement fine-tuning framework based on MLE of reconstructions, with flexibility for sophisticated extensions. Building on this, we incorporate a generalized artificial viscosity term that enhances flow stability and robustness, accompanied by a direct parameterization method and rigorous theoretical guarantees. Experiments demonstrate our method's effectiveness across diverse settings: a toy example provides mechanistic insights into the fine-tuning process, while large-scale evaluations on meteorological forecasting and robotic manipulation policies validate reliable performance improvements.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 62 of its 91 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
62 of 91 references.
Closest ancestors · 6
Same direction, newest first
- 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistency2 Jul
- 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplings28 Apr
- 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transport29 Sep
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 56
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022Video Diffusion Modelscited by 2,280
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
38 more
- 2023Consistency Modelscited by 1,778
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2021Implicit Behavioral Cloningcited by 442
- 2023Improved Techniques for Training Consistency Modelscited by 430
- 2018Conditional Neural Processescited by 421
- 2019Augmented Neural ODEscited by 396
- 2019Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learningcited by 380
- 2018Neural Processescited by 307
- 2019Attentive Neural Processescited by 280
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
- 2022On Neural Differential Equationscited by 264
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
- 2024Consistency Models Made Easycited by 140
- 2022Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelingcited by 126
- 2021Orthogonalizing Convolutional Layers with the Cayley Transformcited by 105
- 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
- 2021Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackscited by 91
- 2023Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglementcited by 89
- 2023Error Bounds for Flow Matching Methodscited by 88
- 2023Simulation-free Schr"odinger bridges via score and flow matchingcited by 81
- 2024Learning Robotic Manipulation Policies from Point Clouds with Conditional Flow Matchingcited by 63
- 2024Riemannian Flow Matching Policy for Robot Motion Learningcited by 61
- 2023One-Step Diffusion Distillation via Deep Equilibrium Modelscited by 60
- 2024Policy Decorator: Model-Agnostic Online Refinement for Large Policy Modelcited by 60
- 2024ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulationcited by 57
- 2024Affordance-based Robot Manipulation with Flow Matchingcited by 54
- 2023Spatio-temporal Diffusion Point Processescited by 52
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 50
- 2023Direct Parameterization of Lipschitz-Bounded Deep Networkscited by 49
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2020Bootstrapping Neural Processescited by 40
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Gradual Fine-Tuning for Flow Matching Models
- 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
- 2025Operator Flow Matching for Timeseries Forecasting
- 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignment
- 2026Physical Fidelity Reconstruction via Improved Consistency-Distilled Flow Matching for Dynamical Systems
- 2024Local Flow Matching Generative Models
- 2025Generative Modeling with Continuous Flows: Sample Complexity of Flow Matching
- 2026Native Extrapolation Awareness in Flow-Based Conditional Generation