mlsanityData to 7 Oct 2026

Seen-to-Scene: Keep the Seen, Generate the Unseen for Video Outpainting

arXiv 2604.14648 ↗First posted 16 Apr 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Video outpainting aims to expand the visible content of a video beyond the original frame boundaries while preserving spatial fidelity and temporal coherence across frames. Existing methods primarily rely on large-scale generative models, such as diffusion models. However, generationbased approaches suffer from implicit temporal modeling and limited spatial context. These limitations lead to intraframe and inter-frame inconsistencies, which become particularly pronounced in dynamic scenes and large outpainting scenarios. To overcome these challenges, we propose Seen-to-Scene, a novel framework that unifies propagationbased and generation-based paradigms for video outpainting. Specifically, Seen-to-Scene leverages flow-based propagation with a flow completion network pre-trained for video inpainting, which is fine-tuned in an end-to-end manner to bridge the domain gap and reconstruct coherent motion fields. To further improve the efficiency and reliability of propagation, we introduce a reference-guided latent propagation that effectively propagates source content across frames. Extensive experiments demonstrate that our method achieves superior temporal coherence and visual realism with efficient inference, surpassing even prior state-of-the-art methods that require input-specific adaptation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

20 of 28 references.

References · 20

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  7. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  8. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
  9. 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
  10. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
  11. 2019Deep Flow-Guided Video Inpaintingcited by 116
  12. 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
8 more
  1. 2022Flow-Guided Transformer for Video Inpaintingcited by 59
  2. 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
  3. 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
  4. 2023Hierarchical Masked 3D Diffusion Model for Video Outpaintingcited by 25
  5. 2024Video Diffusion Models are Strong Video Inpaintercited by 21
  6. 2024Elevating Flow-Guided Video Inpainting with Reference Generationcited by 8
  7. 2026M3DDM+: An improved video outpainting by a modified masking strategycited by 2
  8. 2026GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidancecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models
  2. 2025OutDreamer: Video Outpainting with a Diffusion Transformer
  3. 2025DiffuEraser: A Diffusion Model for Video Inpainting
  4. 2024Salient Object-Aware Background Generation using Text-Guided Diffusion Models
  5. 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos
  6. 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
  7. 2025Geometry-Aware Diffusion Models for Multiview Scene Inpainting
  8. 2023Flow-Guided Diffusion for Video Inpainting