FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Existing optical flow methods broadly follow two paradigms: iterative optimization and diffusion-based estimation. Iterative methods, exemplified by RAFT, achieve high accuracy through recurrent refinement, but remain challenged by large displacements and complex motion. Diffusion-based methods introduce generative modeling and show promise in such ambiguous regions. However, existing diffusion models usually denoise the entire dense flow field from Gaussian noise, including simple regions where reliable motion can already be estimated by a lightweight network. This increases the denoising burden and may cause slow convergence and unstable training. To address this issue, we introduce FlowPainter, a diffusion-based optical flow framework that reformulates dense-flow generation as confidence-guided soft inpainting. FlowPainter employs a lightweight confidence-aware network to predict a rough flow and a pixel-wise confidence mask, distinguishing reliable simple regions from uncertain hard regions. The resulting simple-flow prior is used for confidence-based initialization and further injected into iterative denoising through confidence-gated residual guidance. With dynamically decaying guidance strength, FlowPainter stabilizes early denoising while preserving the flexibility of the diffusion model for late-stage detail refinement. Extensive experiments on public benchmarks, including Sintel, KITTI, and Spring, show that FlowPainter achieves strong accuracy under comparable training settings and converges more efficiently than existing diffusion-based optical flow methods, with notable gains on challenging benchmark splits. Our approach offers a practical way to integrate reliable discriminative priors with diffusion-based refinement for optical flow estimation. Our code is publicly available at https://github.com/mya012/FlowPainter.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 42 of its 51 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
42 of 51 references.
Closest ancestors · 2
Same direction, newest first
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation2 Jun
Other references · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 421
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
28 more
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 121
- 2020MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Maskcited by 117
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2017Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognitioncited by 82
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
- 2018Representation Flow for Action Recognitioncited by 51
- 2018End-to-End Learning of Motion Representation for Video Understandingcited by 43
- 2023Rethinking Optical Flow from Geometric Matching Consistent Perspectivecited by 33
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2022Video Interpolation by Event-driven Anisotropic Adjustment of Optical Flowcited by 18
- 2023GAFlow: Incorporating Gaussian Attention into Optical Flowcited by 18
- 2020Optical Flow based Visual Potential Field for Autonomous Drivingcited by 16
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
- 2023Optical Flow for Autonomous Driving: Applications, Challenges and Improvementscited by 9
- 2025Flow4Agent: Long-form Video Understanding via Motion Prior from Optical Flowcited by 9
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolationcited by 7
- 2025UltraLED: Learning to See Everything in Ultra-High Dynamic Range Scenescited by 7
- 2026MegaFlow: Zero-Shot Large Displacement Optical Flowcited by 5
- 2023Open-DDVM: A Reproduction and Extension of Diffusion Model for Optical Flow Estimationcited by 3
- 2026ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Accelerationcited by 3
- 2026Calibrated Harmonic Overlaid Implicit Neural Representations for Multi-Dimensional Datacited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Diffusion to One-Step Generation: A Comparative Study of Flow-Based Models with Application to Image Inpainting
- 2024Coherent Video Inpainting Using Optical Flow-Guided Efficient Diffusion
- 2023Flow-Guided Diffusion for Video Inpainting
- 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Models
- 2025DiffuEraser: A Diffusion Model for Video Inpainting
- 2023Gradpaint: Gradient-Guided Inpainting with Diffusion Models
- 2024Neuroexplicit Diffusion Models for Inpainting of Optical Flow Fields
- 2026Rethinking Pixel Mean Flows via Interval Denoiser