mlsanityData to 14 Oct 2026

Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising

arXiv 2511.03272 ↗First posted 5 Nov 2025cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Diffusion-based text-to-video models are increasingly capable, but mask-based editing over hundreds of frames remains challenging: na"ive long-video generation suffers from memory blow-up, window seams, and temporal drift, while existing editors often require specialized modules or heavy fine-tuning. We present Overlapping High-Order Co-Denoising, a lightweight framework that turns a single pre-trained text-to-video model into a unified inpainting-outpainting editor. We train only LoRA adapters using mixed interior and border masks together with a dual-region loss that improves synthesis inside the mask while explicitly preserving known content. At inference, we denoise long latent sequences using overlapping windows, apply second-order Heun sampling within each window, and fuse overlaps with Hamming-weighted blending to reduce boundary artifacts and improve temporal coherence. On InpaintBench (30 real-world videos, 81--300 frames), our method outperforms Wan 2.1 variants and VACE in background faithfulness (SSIM/LPIPS), temporal consistency (tLPIPS), and text alignment (CLIP), and scales to long horizons, demonstrated up to 800 frames, with memory bounded by the chosen window size.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 79 of its 102 references that are in the map. First posted on arXiv 5 Nov 2025.

Builds on

79 of 102 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025OutDreamer: Video Outpainting with a Diffusion Transformer27 Jun
  2. 2025DiTPainter: Efficient Video Inpainting with Diffusion Transformers22 Apr
  3. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Model19 Jul
  4. 2023AVID: Any-Length Video Inpainting with Diffusion Model6 Dec

Other references · 75

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2022Generative Adversarial Networkscited by 5,627
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  3. 2022Diffusion Models in Vision: A Surveycited by 1,015
  4. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  5. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  6. 2025VACE: All-in-One Video Creation and Editingcited by 479
  7. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
  8. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
  9. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  10. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
  11. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
  12. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
  13. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  14. 2022Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Qualitycited by 182
  15. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
  16. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  17. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  18. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
  19. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
  20. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  21. 2019Deep Flow-Guided Video Inpaintingcited by 116
  22. 2019Deep Video Inpaintingcited by 109
  23. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
  24. 2025Controllable Video Generation: A Surveycited by 98
  25. 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
  26. 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
  27. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  28. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  29. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
  30. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  31. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  32. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
  33. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
  34. 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 50
  35. 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
  36. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  37. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  38. 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DiffuEraser: A Diffusion Model for Video Inpainting
  2. 2024Coherent Video Inpainting Using Optical Flow-Guided Efficient Diffusion
  3. 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models
  4. 2026M3DDM+: An improved video outpainting by a modified masking strategy
  5. 2023Hierarchical Masked 3D Diffusion Model for Video Outpainting
  6. 2024InVi: Object Insertion In Videos Using Off-the-Shelf Diffusion Models
  7. 2023Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models
  8. 2025End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection