mlsanityData to 7 Oct 2026

From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting

arXiv 2607.14976 ↗First posted 16 Jul 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Video object removal is a fundamental yet challenging task in video editing. Despite recent progress, existing methods typically fall into two categories. Traditional approaches based on optical flow or attention mechanisms often introduce noticeable artifacts and yield unnatural results. In contrast, diffusion-based methods improve visual realism but demand multiple denoising steps, limiting their practicality. To address these issues, we propose From-Draft-to-Draft-Free (D2DF), a framework that distills the ability of transforming coarse drafts into refined videos into a one-step video generation model. Within D2DF, a teacher model is trained to refine low-quality removal results ("drafts") into high-fidelity videos by multiple steps. Then, through Prior-Privileged Consistency Distillation (PPCD), we distill this capability into a student model that performs one-step removal conditioned on the draft. To eliminate draft dependency, we introduce a Self-Guided Fast Planting (SGFP) module based on our Temporal Masked Transformer that autonomously generates scene-consistent pseudo-drafts in latent space, enabling a fully draft-free one-step model. Extensive experiments show that both draft-conditioned and draft-free versions achieve state-of-the-art performance on multiple metrics, surpassing traditional and multi-step generative methods in both quality and efficiency. The denoising process for a single video takes only about 1 second.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 53 of its 64 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

53 of 64 references.

References · 53

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  10. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  11. 2023Consistency Modelscited by 1,778
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
38 more
  1. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  2. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  4. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  5. 2023Adversarial Diffusion Distillationcited by 741
  6. 2022On Distillation of Guided Diffusion Modelscited by 721
  7. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  8. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  9. 2023Improved Techniques for Training Consistency Modelscited by 430
  10. 2018Video-to-Video Synthesiscited by 388
  11. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
  12. 2018Learning Blind Video Temporal Consistencycited by 247
  13. 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
  14. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  15. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
  16. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  17. 2022Fast Sampling of Diffusion Models via Operator Learningcited by 173
  18. 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 162
  19. 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
  20. 2024Consistency Models Made Easycited by 140
  21. 2019Deep Flow-Guided Video Inpaintingcited by 116
  22. 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
  23. 2019Deep Video Inpaintingcited by 107
  24. 2020Flow-edge Guided Video Completioncited by 104
  25. 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
  26. 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
  27. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
  28. 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 74
  29. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
  30. 2022Flow-Guided Transformer for Video Inpaintingcited by 59
  31. 2018Video Inpainting by Jointly Learning Temporal Structure and Spatial Detailscited by 57
  32. 2019Copy-and-Paste Networks for Deep Video Inpaintingcited by 57
  33. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
  34. 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
  35. 2024Towards Language-Driven Video Inpainting via Multimodal Large Language Modelscited by 33
  36. 2025ROSE: Remove Objects with Side Effects in Videoscited by 32
  37. 2023MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generationcited by 26
  38. 2024Video Diffusion Models are Strong Video Inpaintercited by 21

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.