Enhancing Video Inpainting with Aligned Frame Interval Guidance
Not on the map. Why?
Abstract (arXiv)
Recent image-to-video (I2V) based video inpainting methods have made significant strides by leveraging single-image priors and modeling temporal consistency across masked frames. Nevertheless, these methods suffer from severe content degradation within video chunks. Furthermore, the absence of a robust frame alignment scheme compromises intra-chunk and inter-chunk spatiotemporal stability, resulting in insufficient control over the entire video. To address these limitations, we propose VidPivot, a novel framework that decouples video inpainting into two sub-tasks: multi-frame consistent image inpainting and masked area motion propagation. Our approach introduces frame interval priors as spatiotemporal cues to guide the inpainting process. To enhance cross-frame coherence, we design a FrameProp Module that implements a frame content propagation strategy, diffusing reference frame content into subsequent frames via a splicing mechanism. Additionally, a dedicated context controller encodes these coherent frame priors into the I2V generative backbone, effectively serving as soft constrain to suppress content distortion during generation. Extensive evaluations demonstrate that VidPivot achieves competitive performance across diverse benchmarks and generalizes well to different video inpainting scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 55 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
47 of 55 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
35 more
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
- 2019Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGANcited by 87
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
- 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 59
- 2018Video Inpainting by Jointly Learning Temporal Structure and Spatial Detailscited by 58
- 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 50
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
- 2019Onion-Peel Networks for Deep Video Completioncited by 46
- 2024Video Editing via Factorized Diffusion Distillationcited by 41
- 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesiscited by 39
- 2023LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Modelcited by 25
- 2024UniPaint: Unified Space-time Video Inpainting via Mixture-of-Expertscited by 13
- 2024Elevating Flow-Guided Video Inpainting with Reference Generationcited by 9
- 20223DFill:Reference-guided Image Inpainting by Self-supervised 3D Image Alignmentcited by 3
Built on by
Not cited yet.