mlsanityData to 7 Oct 2026

FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion

arXiv 2607.10140 ↗First posted 11 Jul 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Existing optical flow methods broadly follow two paradigms: iterative optimization and diffusion-based estimation. Iterative methods, exemplified by RAFT, achieve high accuracy through recurrent refinement, but remain challenged by large displacements and complex motion. Diffusion-based methods introduce generative modeling and show promise in such ambiguous regions. However, existing diffusion models usually denoise the entire dense flow field from Gaussian noise, including simple regions where reliable motion can already be estimated by a lightweight network. This increases the denoising burden and may cause slow convergence and unstable training. To address this issue, we introduce FlowPainter, a diffusion-based optical flow framework that reformulates dense-flow generation as confidence-guided soft inpainting. FlowPainter employs a lightweight confidence-aware network to predict a rough flow and a pixel-wise confidence mask, distinguishing reliable simple regions from uncertain hard regions. The resulting simple-flow prior is used for confidence-based initialization and further injected into iterative denoising through confidence-gated residual guidance. With dynamically decaying guidance strength, FlowPainter stabilizes early denoising while preserving the flexibility of the diffusion model for late-stage detail refinement. Extensive experiments on public benchmarks, including Sintel, KITTI, and Spring, show that FlowPainter achieves strong accuracy under comparable training settings and converges more efficiently than existing diffusion-based optical flow methods, with notable gains on challenging benchmark splits. Our approach offers a practical way to integrate reliable discriminative priors with diffusion-based refinement for optical flow estimation. Our code is publicly available at https://github.com/mya012/FlowPainter.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 42 of its 51 references that are in the map. First posted on arXiv 11 Jul 2026.

Builds on

42 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
  2. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation2 Jun

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  5. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  6. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  7. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  8. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
  9. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
  10. 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 421
  11. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  12. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
28 more
  1. 2022Unifying Flow, Stereo and Depth Estimationcited by 270
  2. 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
  3. 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
  4. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
  5. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
  6. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
  7. 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 121
  8. 2020MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Maskcited by 117
  9. 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
  10. 2017Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognitioncited by 82
  11. 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
  12. 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
  13. 2018Representation Flow for Action Recognitioncited by 51
  14. 2018End-to-End Learning of Motion Representation for Video Understandingcited by 43
  15. 2023Rethinking Optical Flow from Geometric Matching Consistent Perspectivecited by 33
  16. 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
  17. 2022Video Interpolation by Event-driven Anisotropic Adjustment of Optical Flowcited by 18
  18. 2023GAFlow: Incorporating Gaussian Attention into Optical Flowcited by 18
  19. 2020Optical Flow based Visual Potential Field for Autonomous Drivingcited by 16
  20. 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
  21. 2023Optical Flow for Autonomous Driving: Applications, Challenges and Improvementscited by 9
  22. 2025Flow4Agent: Long-form Video Understanding via Motion Prior from Optical Flowcited by 9
  23. 2025Hierarchical Flow Diffusion for Efficient Frame Interpolationcited by 7
  24. 2025UltraLED: Learning to See Everything in Ultra-High Dynamic Range Scenescited by 7
  25. 2026MegaFlow: Zero-Shot Large Displacement Optical Flowcited by 5
  26. 2023Open-DDVM: A Reproduction and Extension of Diffusion Model for Optical Flow Estimationcited by 3
  27. 2026ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Accelerationcited by 3
  28. 2026Calibrated Harmonic Overlaid Implicit Neural Representations for Multi-Dimensional Datacited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Diffusion to One-Step Generation: A Comparative Study of Flow-Based Models with Application to Image Inpainting
  2. 2024Coherent Video Inpainting Using Optical Flow-Guided Efficient Diffusion
  3. 2023Flow-Guided Diffusion for Video Inpainting
  4. 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Models
  5. 2025DiffuEraser: A Diffusion Model for Video Inpainting
  6. 2023Gradpaint: Gradient-Guided Inpainting with Diffusion Models
  7. 2024Neuroexplicit Diffusion Models for Inpainting of Optical Flow Fields
  8. 2026Rethinking Pixel Mean Flows via Interval Denoiser