Seen-to-Scene: Keep the Seen, Generate the Unseen for Video Outpainting
Not on the map. Why?
Abstract (arXiv)
Video outpainting aims to expand the visible content of a video beyond the original frame boundaries while preserving spatial fidelity and temporal coherence across frames. Existing methods primarily rely on large-scale generative models, such as diffusion models. However, generationbased approaches suffer from implicit temporal modeling and limited spatial context. These limitations lead to intraframe and inter-frame inconsistencies, which become particularly pronounced in dynamic scenes and large outpainting scenarios. To overcome these challenges, we propose Seen-to-Scene, a novel framework that unifies propagationbased and generation-based paradigms for video outpainting. Specifically, Seen-to-Scene leverages flow-based propagation with a flow completion network pre-trained for video inpainting, which is fine-tuned in an end-to-end manner to bridge the domain gap and reconstruct coherent motion fields. To further improve the efficiency and reliability of propagation, we introduce a reference-guided latent propagation that effectively propagates source content across frames. Extensive experiments demonstrate that our method achieves superior temporal coherence and visual realism with efficient inference, surpassing even prior state-of-the-art methods that require input-specific adaptation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
20 of 28 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
8 more
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
- 2023Hierarchical Masked 3D Diffusion Model for Video Outpaintingcited by 25
- 2024Video Diffusion Models are Strong Video Inpaintercited by 21
- 2024Elevating Flow-Guided Video Inpainting with Reference Generationcited by 8
- 2026M3DDM+: An improved video outpainting by a modified masking strategycited by 2
- 2026GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidancecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models
- 2025OutDreamer: Video Outpainting with a Diffusion Transformer
- 2025DiffuEraser: A Diffusion Model for Video Inpainting
- 2024Salient Object-Aware Background Generation using Text-Guided Diffusion Models
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos
- 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
- 2025Geometry-Aware Diffusion Models for Multiview Scene Inpainting
- 2023Flow-Guided Diffusion for Video Inpainting