mlsanityData to 14 Oct 2026

Enhancing Video Inpainting with Aligned Frame Interval Guidance

arXiv 2510.21461 ↗First posted 24 Oct 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent image-to-video (I2V) based video inpainting methods have made significant strides by leveraging single-image priors and modeling temporal consistency across masked frames. Nevertheless, these methods suffer from severe content degradation within video chunks. Furthermore, the absence of a robust frame alignment scheme compromises intra-chunk and inter-chunk spatiotemporal stability, resulting in insufficient control over the entire video. To address these limitations, we propose VidPivot, a novel framework that decouples video inpainting into two sub-tasks: multi-frame consistent image inpainting and masked area motion propagation. Our approach introduces frame interval priors as spatiotemporal cues to guide the inpainting process. To enhance cross-frame coherence, we design a FrameProp Module that implements a frame content propagation strategy, diffusing reference frame content into subsequent frames via a splicing mechanism. Additionally, a dedicated context controller encodes these coherent frame priors into the I2V generative backbone, effectively serving as soft constrain to suppress content distortion during generation. Extensive evaluations demonstrate that VidPivot achieves competitive performance across diverse benchmarks and generalizes well to different video inpainting scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 55 references that are in the map. First posted on arXiv 24 Oct 2025.

Builds on

47 of 55 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
35 more
  1. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  2. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  3. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  4. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  5. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  6. 2025VACE: All-in-One Video Creation and Editingcited by 479
  7. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  8. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  9. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  10. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
  11. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  12. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  13. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  14. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  15. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
  16. 2019Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGANcited by 87
  17. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  18. 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
  19. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  20. 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
  21. 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
  22. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
  23. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
  24. 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 59
  25. 2018Video Inpainting by Jointly Learning Temporal Structure and Spatial Detailscited by 58
  26. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 50
  27. 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
  28. 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
  29. 2019Onion-Peel Networks for Deep Video Completioncited by 46
  30. 2024Video Editing via Factorized Diffusion Distillationcited by 41
  31. 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesiscited by 39
  32. 2023LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Modelcited by 25
  33. 2024UniPaint: Unified Space-time Video Inpainting via Mixture-of-Expertscited by 13
  34. 2024Elevating Flow-Guided Video Inpainting with Reference Generationcited by 9
  35. 20223DFill:Reference-guided Image Inpainting by Self-supervised 3D Image Alignmentcited by 3

Built on by

Not cited yet.