Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Diffusion-based text-to-video models are increasingly capable, but mask-based editing over hundreds of frames remains challenging: na"ive long-video generation suffers from memory blow-up, window seams, and temporal drift, while existing editors often require specialized modules or heavy fine-tuning. We present Overlapping High-Order Co-Denoising, a lightweight framework that turns a single pre-trained text-to-video model into a unified inpainting-outpainting editor. We train only LoRA adapters using mixed interior and border masks together with a dual-region loss that improves synthesis inside the mask while explicitly preserving known content. At inference, we denoise long latent sequences using overlapping windows, apply second-order Heun sampling within each window, and fuse overlaps with Hamming-weighted blending to reduce boundary artifacts and improve temporal coherence. On InpaintBench (30 real-world videos, 81--300 frames), our method outperforms Wan 2.1 variants and VACE in background faithfulness (SSIM/LPIPS), temporal consistency (tLPIPS), and text alignment (CLIP), and scales to long horizons, demonstrated up to 800 frames, with memory bounded by the chosen window size.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 79 of its 102 references that are in the map. First posted on arXiv 5 Nov 2025.
Builds on
79 of 102 references.
Closest ancestors · 4
Same direction, newest first
- 2025OutDreamer: Video Outpainting with a Diffusion Transformer27 Jun
- 2025DiTPainter: Efficient Video Inpainting with Diffusion Transformers22 Apr
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Model19 Jul
- 2023AVID: Any-Length Video Inpainting with Diffusion Model6 Dec
Other references · 75
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Generative Adversarial Networkscited by 5,627
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2022Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Qualitycited by 182
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2019Deep Video Inpaintingcited by 109
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2025Controllable Video Generation: A Surveycited by 98
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
- 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
- 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 50
- 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025DiffuEraser: A Diffusion Model for Video Inpainting
- 2024Coherent Video Inpainting Using Optical Flow-Guided Efficient Diffusion
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models
- 2026M3DDM+: An improved video outpainting by a modified masking strategy
- 2023Hierarchical Masked 3D Diffusion Model for Video Outpainting
- 2024InVi: Object Insertion In Videos Using Off-the-Shelf Diffusion Models
- 2023Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models
- 2025End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection