Deep Flow-Guided Video Inpainting
Not on the map. Why?
Abstract (arXiv)
Video inpainting, which aims at filling in missing regions of a video, remains challenging due to the difficulty of preserving the precise spatial and temporal coherence of video contents. In this work we propose a novel flow-guided video inpainting approach. Rather than filling in the RGB pixels of each frame directly, we consider video inpainting as a pixel propagation problem. We first synthesize a spatially and temporally coherent optical flow field across video frames using a newly designed Deep Flow Completion network. Then the synthesized flow field is used to guide the propagation of pixels to fill up the missing regions in the video. Specifically, the Deep Flow Completion network follows a coarse-to-fine refinement to complete the flow fields, while their quality is further improved by hard flow example mining. Following the guide of the completed flow, the missing video regions can be filled up precisely. Our method is evaluated on DAVIS and YouTube-VOS datasets qualitatively and quantitatively, achieving the state-of-the-art performance in terms of inpainting quality and speed.
Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 20; 2023: 21; 2024: 14; 2025: 21; 2026: 18.
116 papers.
Sort:
By area:
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
38 more
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2023DNeRV: Modeling Inherent Dynamics via Difference Neural Representation for Videoscited by 42
- 2021Progressive Temporal Feature Alignment Network for Video Inpaintingcited by 34
- 2022Learning Optical Flow with Adaptive Graph Reasoningcited by 33
- 2022Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generationcited by 32
- 2022Bringing Old Films Back to Lifecited by 31
- 2021Occlusion-Aware Video Object Inpaintingcited by 30
- 2021Decoupled Spatial-Temporal Transformer for Video Inpaintingcited by 28
- 2022ClothFormer:Taming Video Virtual Try-on in All Modulecited by 26
- 2023Learning Optical Flow from Event Camera with Rendered Datasetcited by 26
- 2021Learning Semantic-Aware Dynamics for Video Predictioncited by 21
- 2023Look Ma, No Hands! Agent-Environment Factorization of Egocentric Videoscited by 21
- 2022Error Compensation Framework for Flow-Guided Video Inpaintingcited by 20
- 2021Internal Video Inpainting by Implicit Long-range Propagationcited by 19
- 2026NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Resultscited by 15
- 2023Bitstream-Corrupted Video Recovery: A Novel Benchmark Dataset and Methodcited by 14
- 2025MTV-Inpaint: Multi-Task Long Video Inpaintingcited by 14
- 2021Seeing Through Clouds in Satellite Imagescited by 13
- 2022BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorizationcited by 13
- 2024UniPaint: Unified Space-time Video Inpainting via Mixture-of-Expertscited by 13
- 2021Flow-Guided Video Inpainting with Scene Templatescited by 12
- 2022Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesiscited by 12
- 2022DeViT: Deformed Vision Transformers in Video Inpaintingcited by 12
- 2021Deep Video Inpainting Detectioncited by 11
- 2021The DEVIL is in the Details: A Diagnostic Evaluation Benchmark for Video Inpaintingcited by 11
- 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2021Let's See Clearly: Contaminant Artifact Removal for Moving Camerascited by 9
- 2024Infrared Small Target Detection in Satellite Videos: A New Dataset and A Novel Recurrent Feature Refinement Frameworkcited by 9
- 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 9
- 2021A Shape-Aware Retargeting Approach to Transfer Human Motion and Appearance in Monocular Videoscited by 8
- 2021M3L: Language-based Video Editing via Multi-Modal Multi-Level Transformerscited by 8
- 2022Semi-Supervised Video Inpainting with Cycle Consistency Constraintscited by 8
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehiclecited by 8
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Modelscited by 8
- 2021Deep Face Video Inpainting via UV Mappingcited by 7
50 most cited of 116 All 116 (JSON)
- 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal15 Sep 2026
- 2026WiFlow: Estimating Optical Flow using WiFi Channel State Information2 Sep 2026
- 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting16 Jul 2026
- 2026AbsoluteDegradation: A Physics-Inspired Synthetic Film-Degradation Pipeline and Archival Film Restoration Benchmark2 Jul 2026
- 2026DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulation30 Jun 2026
- 2026HL-OutPaint: Coarse-to-Fine Video Outpainting for High-Resolution Long-Range Videos17 May 2026
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution13 May 2026
- 2026Seen-to-Scene: Keep the Seen, Generate the Unseen for Video Outpainting16 Apr 2026
- 2026Controllable Video Object Insertion via Multi-View Priors16 Apr 2026
- 2026Blind Bitstream-corrupted Video Recovery via Metadata-guided Diffusion Model15 Apr 2026
- 2026NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Results8 Apr 2026
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal2 Apr 2026
38 more
- 2026FlowIt: Global Matching via Hierarchical Transformers and Optimal Transport for Optical Flow30 Mar 2026
- 2026CLEAR: Context-Aware Learning with End-to-End Mask-Free Inference for Adaptive Video Subtitle Removal23 Mar 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2026PISCO: Precise Video Instance Insertion with Sparse Control9 Feb 2026
- 2026GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidance10 Jan 2026
- 2026Object-WIPER : Training-Free Object and Associated Effect Removal in Videos10 Jan 2026
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025Removing Cost Volumes from Optical Flow Estimators15 Oct 2025
- 2025FreeViS: Training-free Video Stylization with Inconsistent References2 Oct 2025
- 2025DAOVI: Distortion-Aware Omnidirectional Video Inpainting30 Aug 2025
- 2025DreamSwapV: Mask-guided Subject Swapping for Any Customized Video Editing20 Aug 2025
- 2025MagicRoad: Semantic-Aware 3D Road Surface Reconstruction via Obstacle Inpainting31 Jul 2025
- 2025Towards Blind Bitstream-corrupted Video Recovery via a Visual Foundation Model-driven Framework30 Jul 2025
- 2025PriOr-Flow: Enhancing Primitive Panoramic Optical Flow with Orthogonal View30 Jun 2025
- 2025OutDreamer: Video Outpainting with a Diffusion Transformer27 Jun 2025
- 2025Efficient All-Pairs Correlation Volume Sampling for Optical Flow Estimation22 May 2025
- 2025Shape-Guided Clothing Warping for Virtual Try-On21 Apr 2025
- 2025VIP: Video Inpainting Pipeline for Real World Human Removal3 Apr 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2025Temporal-Consistent Video Restoration with Pre-trained Diffusion Models19 Mar 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025MTV-Inpaint: Multi-Task Long Video Inpainting14 Mar 2025
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control7 Mar 2025
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotations3 Feb 2025
- 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Models21 Jan 2025
- 2024UniPaint: Unified Space-time Video Inpainting via Mixture-of-Experts9 Dec 2024
- 2024Replace Anyone in Videos30 Sep 2024
- 2024Infrared Small Target Detection in Satellite Videos: A New Dataset and A Novel Recurrent Feature Refinement Framework19 Sep 2024
- 2024Pattern Guided UV Recovery for Realistic Video Garment Texturing14 Jul 2024
- 2024DaBiT: Depth and Blur informed Transformer for Video Focal Deblurring1 Jul 2024
- 2024Learning-Based WiFi Fingerprint Inpainting via Generative Adversarial Networks4 Jun 2024
- 20243D StreetUnveiler with Semantic-aware 2DGS -- a simple baseline28 May 2024
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow23 May 2024
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models30 Apr 2024
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior17 Apr 2024
- 2024Towards Online Real-Time Memory-based Video Inpainting Transformers24 Mar 2024
50 newest of 116 All 116 (JSON)
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2023Look Ma, No Hands! Agent-Environment Factorization of Egocentric Videoscited by 21
- 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 9
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Modelscited by 8
- 2024Replace Anyone in Videoscited by 4
- 2025Temporal-Consistent Video Restoration with Pre-trained Diffusion Modelscited by 4
- 2025OutDreamer: Video Outpainting with a Diffusion Transformercited by 4
- 2023Infusion: internal diffusion for inpainting of dynamic textures and complex motioncited by 1
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
12 most cited of 15 All 15 (JSON)
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution13 May 2026
- 2026Blind Bitstream-corrupted Video Recovery via Metadata-guided Diffusion Model15 Apr 2026
- 2026PISCO: Precise Video Instance Insertion with Sparse Control9 Feb 2026
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025OutDreamer: Video Outpainting with a Diffusion Transformer27 Jun 2025
- 2025Temporal-Consistent Video Restoration with Pre-trained Diffusion Models19 Mar 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Models21 Jan 2025
- 2024Replace Anyone in Videos30 Sep 2024
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models30 Apr 2024
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior17 Apr 2024
- 2023AVID: Any-Length Video Inpainting with Diffusion Model6 Dec 2023
12 newest of 15 All 15 (JSON)
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
12 most cited of 100 All 100 (JSON)
- 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal15 Sep 2026
- 2026WiFlow: Estimating Optical Flow using WiFi Channel State Information2 Sep 2026
- 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting16 Jul 2026
- 2026AbsoluteDegradation: A Physics-Inspired Synthetic Film-Degradation Pipeline and Archival Film Restoration Benchmark2 Jul 2026
- 2026HL-OutPaint: Coarse-to-Fine Video Outpainting for High-Resolution Long-Range Videos17 May 2026
- 2026Seen-to-Scene: Keep the Seen, Generate the Unseen for Video Outpainting16 Apr 2026
- 2026Controllable Video Object Insertion via Multi-View Priors16 Apr 2026
- 2026NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Results8 Apr 2026
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal2 Apr 2026
- 2026FlowIt: Global Matching via Hierarchical Transformers and Optimal Transport for Optical Flow30 Mar 2026
- 2026CLEAR: Context-Aware Learning with End-to-End Mask-Free Inference for Adaptive Video Subtitle Removal23 Mar 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
12 newest of 100 All 100 (JSON)