Reimagining Reality: A Comprehensive Survey of Video Inpainting Techniques
Not on the map. Why?
Abstract (arXiv)
This paper offers a comprehensive analysis of recent advancements in video inpainting techniques, a critical subset of computer vision and artificial intelligence. As a process that restores or fills in missing or corrupted portions of video sequences with plausible content, video inpainting has evolved significantly with the advent of deep learning methodologies. Despite the plethora of existing methods and their swift development, the landscape remains complex, posing challenges to both novices and established researchers. Our study deconstructs major techniques, their underpinning theories, and their effective applications. Moreover, we conduct an exhaustive comparative study, centering on two often-overlooked dimensions: visual quality and computational efficiency. We adopt a human-centric approach to assess visual quality, enlisting a panel of annotators to evaluate the output of different video inpainting techniques. This provides a nuanced qualitative understanding that complements traditional quantitative metrics. Concurrently, we delve into the computational aspects, comparing inference times and memory demands across a standardized hardware setup. This analysis underscores the balance between quality and efficiency: a critical consideration for practical applications where resources may be constrained. By integrating human validation and computational resource comparison, this survey not only clarifies the present landscape of video inpainting techniques but also charts a course for future explorations in this vibrant and evolving field.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 59 references that are in the map. First posted on arXiv 31 Jan 2024.
Builds on
36 of 59 references.
References · 36
- 2022Generative Adversarial Networkscited by 5,603
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 307
- 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 162
- 2020Human Action Recognition from Various Data Modalities: A Reviewcited by 162
- 2022Diffusion Models for Video Prediction and Infillingcited by 134
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2019Deep Video Inpaintingcited by 107
24 more
- 2020Flow-edge Guided Video Completioncited by 104
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2018VideoMatch: Matching based Video Object Segmentationcited by 90
- 2020SMART Frame Selection for Action Recognitioncited by 73
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2019Copy-and-Paste Networks for Deep Video Inpaintingcited by 57
- 2020Future Video Synthesis with Object Motion Predictioncited by 57
- 2020VideoMix: Rethinking Data Augmentation for Video Classificationcited by 55
- 2019Video Object Segmentation and Tracking: A Surveycited by 49
- 2019An Internal Learning Approach to Video Inpaintingcited by 33
- 2019ColorNet: Investigating the importance of color spaces for image classificationcited by 31
- 2021Occlusion-Aware Video Object Inpaintingcited by 30
- 2022Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognitioncited by 27
- 2022Error Compensation Framework for Flow-Guided Video Inpaintingcited by 20
- 2021Flow-Guided Video Inpainting with Scene Templatescited by 12
- 2022DeViT: Deformed Vision Transformers in Video Inpaintingcited by 12
- 2020Restore from Restored: Video Restoration with Pseudo Clean Videocited by 11
- 2021The DEVIL is in the Details: A Diagnostic Evaluation Benchmark for Video Inpaintingcited by 11
- 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2019AutoRemover: Automatic Object Removal for Autonomous Driving Videoscited by 8
- 2023Exploiting Optical Flow Guidance for Transformer-Based Video Inpaintingcited by 6
- 2019Frame-Recurrent Video Inpainting by Robust Optical Flow Inferencecited by 3
- 2023Infusion: internal diffusion for inpainting of dynamic textures and complex motioncited by 1
Built on by
Not cited yet.