GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidance
Not on the map. Why?
Abstract (arXiv)
Video outpainting extends a video beyond its original boundaries by synthesizing missing border content. Compared with image outpainting, it requires not only per-frame spatial plausibility but also long-range temporal coherence, especially when outpainted content becomes visible across time under camera or object motion. We propose GlobalPaint, a diffusion-based framework for spatiotemporal coherent video outpainting. Our approach adopts a hierarchical pipeline that first outpaints key frames and then completes intermediate frames via an interpolation model conditioned on the completed boundaries, reducing error accumulation in sequential processing. At the model level, we augment a pretrained image inpainting backbone with (i) an Enhanced Spatial-Temporal module featuring 3D windowed attention for stronger spatiotemporal interaction, and (ii) global feature guidance that distills OpenCLIP features from observed regions across all frames into compact global tokens using a dedicated extractor. Comprehensive evaluations on benchmark datasets demonstrate improved reconstruction quality and more natural motion compared to prior methods. Our demo page is https://yuemingpan.github.io/GlobalPaint/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 46 references that are in the map. First posted on arXiv 10 Jan 2026.
Builds on
35 of 46 references.
References · 35
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
23 more
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
- 2022Blended Latent Diffusioncited by 430
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 162
- 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2020Flow-edge Guided Video Completioncited by 104
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
- 2021Decoupled Spatial-Temporal Transformer for Video Inpaintingcited by 28
- 2023Hierarchical Masked 3D Diffusion Model for Video Outpaintingcited by 25
- 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.