Flow-edge Guided Video Completion
Not on the map. Why?
Abstract (arXiv)
We present a new flow-based video completion algorithm. Previous flow completion methods are often unable to retain the sharpness of motion boundaries. Our method first extracts and completes motion edges, and then uses them to guide piecewise-smooth flow completion with sharp edges. Existing methods propagate colors among local flow connections between adjacent frames. However, not all missing regions in a video can be reached in this way because the motion boundaries form impenetrable barriers. Our method alleviates this problem by introducing non-local flow connections to temporally distant frames, enabling propagating video content over motion boundaries. We validate our approach on the DAVIS dataset. Both visual and quantitative results show that our method compares favorably against the state-of-the-art algorithms.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 20; 2023: 22; 2024: 18; 2025: 18; 2026: 9.
104 papers.
Sort:
By area:
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
38 more
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2023Shape-aware Text-driven Layered Video Editingcited by 54
- 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2021Progressive Temporal Feature Alignment Network for Video Inpaintingcited by 34
- 2023Rethinking Optical Flow from Geometric Matching Consistent Perspectivecited by 33
- 2022Bringing Old Films Back to Lifecited by 31
- 2021Occlusion-Aware Video Object Inpaintingcited by 30
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
- 2021Decoupled Spatial-Temporal Transformer for Video Inpaintingcited by 28
- 2022The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editingcited by 24
- 2021Hybrid Neural Fusion for Full-frame Video Stabilizationcited by 21
- 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
- 2024Video Diffusion Models are Strong Video Inpaintercited by 21
- 2022Error Compensation Framework for Flow-Guided Video Inpaintingcited by 20
- 2021Internal Video Inpainting by Implicit Long-range Propagationcited by 19
- 2023AccFlow: Backward Accumulation for Long-Range Optical Flowcited by 19
- 2023SAMFlow: Eliminating Any Fragmentation in Optical Flow with Segment Anything Modelcited by 15
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 15
- 2022Optical Flow Training under Limited Label Budget via Active Learningcited by 14
- 2023Bitstream-Corrupted Video Recovery: A Novel Benchmark Dataset and Methodcited by 14
- 2025MTV-Inpaint: Multi-Task Long Video Inpaintingcited by 14
- 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generationcited by 13
- 2021Flow-Guided Video Inpainting with Scene Templatescited by 12
- 2022DeViT: Deformed Vision Transformers in Video Inpaintingcited by 12
- 2021Deep Video Inpainting Detectioncited by 11
- 2021The DEVIL is in the Details: A Diagnostic Evaluation Benchmark for Video Inpaintingcited by 11
- 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
- 2024VidPanos: Generative Panoramic Videos from Casual Panning Videoscited by 11
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Drivingcited by 9
- 2023GRACE: Loss-Resilient Real-Time Video through Neural Codecscited by 9
- 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 9
- 2022Semi-Supervised Video Inpainting with Cycle Consistency Constraintscited by 8
- 2022FactorMatte: Redefining Video Matting for Re-Composition Taskscited by 8
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Modelscited by 8
50 most cited of 104 All 104 (JSON)
- 2026WiFlow: Estimating Optical Flow using WiFi Channel State Information2 Sep 2026
- 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting16 Jul 2026
- 2026Rethinking Dense Optical Flow without Test-Time Scaling8 May 2026
- 2026Blind Bitstream-corrupted Video Recovery via Metadata-guided Diffusion Model15 Apr 2026
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal2 Apr 2026
- 2026FlowIt: Global Matching via Hierarchical Transformers and Optimal Transport for Optical Flow30 Mar 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2026PISCO: Precise Video Instance Insertion with Sparse Control9 Feb 2026
- 2026GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidance10 Jan 2026
- 20253One2: One-step Regression Plus One-step Diffusion for One-hot Modulation in Dual-path Video Snapshot Compressive Imaging19 Dec 2025
- 2025Disturbance-Free Surgical Video Generation from Multi-Camera Shadowless Lamps for Open Surgery9 Dec 2025
- 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generation16 Oct 2025
38 more
- 2025Removing Cost Volumes from Optical Flow Estimators15 Oct 2025
- 2025DAOVI: Distortion-Aware Omnidirectional Video Inpainting30 Aug 2025
- 2025IN2OUT: Fine-Tuning Video Inpainting Model for Video Outpainting Using Hierarchical Discriminator1 Aug 2025
- 2025DiGA3D: Coarse-to-Fine Diffusional Propagation of Geometry and Appearance for Versatile 3D Inpainting1 Jul 2025
- 2025PriOr-Flow: Enhancing Primitive Panoramic Optical Flow with Orthogonal View30 Jun 2025
- 2025OutDreamer: Video Outpainting with a Diffusion Transformer27 Jun 2025
- 2025VIP: Video Inpainting Pipeline for Real World Human Removal3 Apr 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Models23 Mar 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025MTV-Inpaint: Multi-Task Long Video Inpainting14 Mar 2025
- 2025Online Dense Point Tracking with Streaming Memory9 Mar 2025
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control7 Mar 2025
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotations3 Feb 2025
- 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Models21 Jan 2025
- 2024Context-Aware Input Orchestration for Video Inpainting25 Nov 2024
- 2024Generative Omnimatte: Learning to Decompose Video into Layers25 Nov 2024
- 2024VidPanos: Generative Panoramic Videos from Casual Panning Videos17 Oct 2024
- 2024Video Diffusion Models are Strong Video Inpainter21 Aug 2024
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editing15 Aug 2024
- 2024Pattern Guided UV Recovery for Realistic Video Garment Texturing14 Jul 2024
- 2024DaBiT: Depth and Blur informed Transformer for Video Focal Deblurring1 Jul 2024
- 2024Trusted Video Inpainting Localization via Deep Attentive Noise Learning19 Jun 2024
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow23 May 2024
- 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Model4 May 2024
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models30 Apr 2024
- 2024Raformer: Redundancy-Aware Transformer for Video Wire Inpainting24 Apr 2024
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior17 Apr 2024
- 2024MemFlow: Optical Flow Estimation and Prediction with Memory7 Apr 2024
- 2024Towards Online Real-Time Memory-based Video Inpainting Transformers24 Mar 2024
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptation20 Mar 2024
- 2024Reimagining Reality: A Comprehensive Survey of Video Inpainting Techniques31 Jan 2024
- 2024Deep Learning-based Image and Video Inpainting: A Survey7 Jan 2024
- 2023Open-DDVM: A Reproduction and Extension of Diffusion Model for Optical Flow Estimation4 Dec 2023
- 2023DeepDR: Deep Structure-Aware RGB-D Inpainting for Diminished Reality1 Dec 2023
- 2023Flow-Guided Diffusion for Video Inpainting26 Nov 2023
- 2023Infusion: internal diffusion for inpainting of dynamic textures and complex motion2 Nov 2023
- 2023Deep Video Inpainting Guided by Audio-Visual Self-Supervision11 Oct 2023
50 newest of 104 All 104 (JSON)
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2024Video Diffusion Models are Strong Video Inpaintercited by 21
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 15
- 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 9
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Modelscited by 8
- 2025OutDreamer: Video Outpainting with a Diffusion Transformercited by 4
- 2023Open-DDVM: A Reproduction and Extension of Diffusion Model for Optical Flow Estimationcited by 3
- 2025DiGA3D: Coarse-to-Fine Diffusional Propagation of Geometry and Appearance for Versatile 3D Inpaintingcited by 3
- 2023Infusion: internal diffusion for inpainting of dynamic textures and complex motioncited by 1
- 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Blind Bitstream-corrupted Video Recovery via Metadata-guided Diffusion Model15 Apr 2026
- 2026PISCO: Precise Video Instance Insertion with Sparse Control9 Feb 2026
- 2025DiGA3D: Coarse-to-Fine Diffusional Propagation of Geometry and Appearance for Versatile 3D Inpainting1 Jul 2025
- 2025OutDreamer: Video Outpainting with a Diffusion Transformer27 Jun 2025
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Models23 Mar 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Models21 Jan 2025
- 2024Video Diffusion Models are Strong Video Inpainter21 Aug 2024
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models30 Apr 2024
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior17 Apr 2024
- 2023Open-DDVM: A Reproduction and Extension of Diffusion Model for Optical Flow Estimation4 Dec 2023
- 2023Flow-Guided Diffusion for Video Inpainting26 Nov 2023
12 newest of 13 All 13 (JSON)
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
12 most cited of 91 All 91 (JSON)
- 2026WiFlow: Estimating Optical Flow using WiFi Channel State Information2 Sep 2026
- 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting16 Jul 2026
- 2026Rethinking Dense Optical Flow without Test-Time Scaling8 May 2026
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal2 Apr 2026
- 2026FlowIt: Global Matching via Hierarchical Transformers and Optimal Transport for Optical Flow30 Mar 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2026GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidance10 Jan 2026
- 20253One2: One-step Regression Plus One-step Diffusion for One-hot Modulation in Dual-path Video Snapshot Compressive Imaging19 Dec 2025
- 2025Disturbance-Free Surgical Video Generation from Multi-Camera Shadowless Lamps for Open Surgery9 Dec 2025
- 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generation16 Oct 2025
- 2025Removing Cost Volumes from Optical Flow Estimators15 Oct 2025
- 2025DAOVI: Distortion-Aware Omnidirectional Video Inpainting30 Aug 2025
12 newest of 91 All 91 (JSON)