Solving Inverse Problems with Flow-based Models via Model Predictive Control
Not on the map. Why?
Abstract (arXiv)
Flow-based generative models provide strong unconditional priors for inverse problems, but guiding their dynamics for conditional generation remains challenging. Recent work casts training-free conditional generation in flow models as an optimal control problem; however, solving the resulting trajectory optimisation is computationally and memory intensive, requiring differentiation through the flow dynamics or adjoint solves. We propose MPC-Flow, a model predictive control framework that formulates inverse problem solving with flow-based generative models as a sequence of control sub-problems, enabling practical optimal control-based guidance at inference time. We provide theoretical analysis linking MPC-Flow to the underlying optimal control objective and show how different algorithmic choices yield a spectrum of guidance algorithms, including regimes that avoid backpropagation through the generative model trajectory. We evaluate MPC-Flow on benchmark image restoration tasks, spanning linear and non-linear settings such as in-painting, deblurring, and super-resolution, and demonstrate strong performance and scalability to massive state-of-the-art architectures via training-free guidance of FLUX.2 (32B) in a quantised setting on consumer hardware.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 47 of its 60 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
47 of 60 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
35 more
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2016Training Deep Nets with Sublinear Memory Costcited by 848
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
- 2017Reinforcement Learning with Deep Energy-Based Policiescited by 669
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2024Flow Matching Guide and Codecited by 301
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 233
- 2023A Variational Perspective on Solving Inverse Problems with Diffusion Modelscited by 222
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 197
- 2023Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistencycited by 182
- 2021Path Integral Sampler: a stochastic control approach for samplingcited by 181
- 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealingcited by 163
- 2023Denoising Diffusion Samplerscited by 149
- 2022An optimal control perspective on diffusion-based generative modelingcited by 147
- 2024Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decodingcited by 136
- 2024D-Flow: Differentiating through Flows for Controlled Generationcited by 122
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 97
- 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Reviewcited by 88
- 2023Training-free Linear Image Inverses via Flowscited by 72
- 2025FlowDPS: Flow-Driven Posterior Sampling for Inverse Problemscited by 68
- 2024DMPlug: A Plug-in Method for Solving Inverse Problems with Diffusion Modelscited by 61
- 2021Explore Image Deblurring via Blur Kernel Spacecited by 58
- 2024Flow Priors for Linear Inverse Problems via Iterative Corrupted Trajectory Matchingcited by 53
- 2024RB-Modulation: Training-Free Personalization of Diffusion Models using Stochastic Optimal Controlcited by 48
- 2024DEFT: Efficient Fine-Tuning of Diffusion Models by Learning the Generalised h-transformcited by 46
- 2015From Facial Parts Responses to Face Detection: A Deep Learning Approachcited by 42
- 2024Steering Rectified Flow Models in the Vector Field for Controlled Image Generationcited by 39
- 2024Training Free Guided Flow Matching with Optimal Controlcited by 25
- 2025Variational Control for Guidance in Diffusion Modelscited by 22
- 2025Solving Inverse Problems with FLAIRcited by 17
- 2025SimpleFold: Folding Proteins is Simpler than You Thinkcited by 16
- 2023Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstructioncited by 15
- 2025Value Gradient Guidance for Flow Matching Alignmentcited by 14
- 2025HardFlow: Hard-Constrained Sampling for Flow-Matching Models via Trajectory Optimizationcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.