From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting
Not on the map. Why?
Abstract (arXiv)
Video object removal is a fundamental yet challenging task in video editing. Despite recent progress, existing methods typically fall into two categories. Traditional approaches based on optical flow or attention mechanisms often introduce noticeable artifacts and yield unnatural results. In contrast, diffusion-based methods improve visual realism but demand multiple denoising steps, limiting their practicality. To address these issues, we propose From-Draft-to-Draft-Free (D2DF), a framework that distills the ability of transforming coarse drafts into refined videos into a one-step video generation model. Within D2DF, a teacher model is trained to refine low-quality removal results ("drafts") into high-fidelity videos by multiple steps. Then, through Prior-Privileged Consistency Distillation (PPCD), we distill this capability into a student model that performs one-step removal conditioned on the draft. To eliminate draft dependency, we introduce a Self-Guided Fast Planting (SGFP) module based on our Temporal Masked Transformer that autonomously generates scene-consistent pseudo-drafts in latent space, enabling a fully draft-free one-step model. Extensive experiments show that both draft-conditioned and draft-free versions achieve state-of-the-art performance on multiple metrics, surpassing traditional and multi-step generative methods in both quality and efficiency. The denoising process for a single video takes only about 1 second.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 53 of its 64 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
53 of 64 references.
References · 53
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Consistency Modelscited by 1,778
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
38 more
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2023Adversarial Diffusion Distillationcited by 741
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
- 2023Improved Techniques for Training Consistency Modelscited by 430
- 2018Video-to-Video Synthesiscited by 388
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
- 2018Learning Blind Video Temporal Consistencycited by 247
- 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
- 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2022Fast Sampling of Diffusion Models via Operator Learningcited by 173
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 162
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2024Consistency Models Made Easycited by 140
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2019Deep Video Inpaintingcited by 107
- 2020Flow-edge Guided Video Completioncited by 104
- 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 74
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2018Video Inpainting by Jointly Learning Temporal Structure and Spatial Detailscited by 57
- 2019Copy-and-Paste Networks for Deep Video Inpaintingcited by 57
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
- 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
- 2024Towards Language-Driven Video Inpainting via Multimodal Large Language Modelscited by 33
- 2025ROSE: Remove Objects with Side Effects in Videoscited by 32
- 2023MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generationcited by 26
- 2024Video Diffusion Models are Strong Video Inpaintercited by 21
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.