mlsanityData to 7 Oct 2026

GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidance

arXiv 2601.06413 ↗First posted 10 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Video outpainting extends a video beyond its original boundaries by synthesizing missing border content. Compared with image outpainting, it requires not only per-frame spatial plausibility but also long-range temporal coherence, especially when outpainted content becomes visible across time under camera or object motion. We propose GlobalPaint, a diffusion-based framework for spatiotemporal coherent video outpainting. Our approach adopts a hierarchical pipeline that first outpaints key frames and then completes intermediate frames via an interpolation model conditioned on the completed boundaries, reducing error accumulation in sequential processing. At the model level, we augment a pretrained image inpainting backbone with (i) an Enhanced Spatial-Temporal module featuring 3D windowed attention for stronger spatiotemporal interaction, and (ii) global feature guidance that distills OpenCLIP features from observed regions across all frames into compact global tokens using a dedicated extractor. Comprehensive evaluations on benchmark datasets demonstrate improved reconstruction quality and more natural motion compared to prior methods. Our demo page is https://yuemingpan.github.io/GlobalPaint/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 46 references that are in the map. First posted on arXiv 10 Jan 2026.

Builds on

35 of 46 references.

References · 35

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  12. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
23 more
  1. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  2. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  3. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  4. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  5. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  6. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  7. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  8. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
  9. 2022Blended Latent Diffusioncited by 430
  10. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  11. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
  12. 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 162
  13. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
  14. 2019Deep Flow-Guided Video Inpaintingcited by 116
  15. 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
  16. 2020Flow-edge Guided Video Completioncited by 104
  17. 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
  18. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
  19. 2022Flow-Guided Transformer for Video Inpaintingcited by 59
  20. 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
  21. 2021Decoupled Spatial-Temporal Transformer for Video Inpaintingcited by 28
  22. 2023Hierarchical Masked 3D Diffusion Model for Video Outpaintingcited by 25
  23. 2023Flow-Guided Diffusion for Video Inpaintingcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.