mlsanityData to 14 Oct 2026

Object-WIPER : Training-Free Object and Associated Effect Removal in Videos

arXiv 2601.06391 ↗First posted 10 Jan 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce Object-WIPER, a training-free framework for removing dynamic objects and their associated visual effects from videos, and inpainting them with semantically consistent and temporally coherent content. Our approach leverages a pre-trained text-to-video diffusion transformer (DiT). Given an input video, a user-provided object mask, and query tokens describing the target object and its effects, we localize relevant visual tokens via visual-text cross-attention and visual self-attention. This produces an intermediate effect mask that we fuse with the user mask to obtain a final foreground token mask to replace. We first invert the video through the DiT to obtain structured noise, then reinitialize the masked tokens with Gaussian noise while preserving background tokens. During denoising, we copy values for the background tokens saved during inversion to maintain scene fidelity. To address the lack of suitable evaluation, we introduce a new object removal metric that rewards temporal consistency among foreground tokens across consecutive frames, coherence between foreground and background tokens within each frame, and dissimilarity between the input and output foreground tokens. Experiments on DAVIS and a newly curated real-world associated effect benchmark (WIPER-Bench) show that Object-WIPER surpasses both training-based and training-free baselines in terms of the metric, achieving clean removal and temporally stable reconstruction without any retraining. Our new benchmark, source code, and pre-trained models will be publicly available.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 10 Jan 2026.

Builds on

36 of 46 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2025DINOv3cited by 1,414
  9. 2025VACE: All-in-One Video Creation and Editingcited by 479
  10. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  11. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  12. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
24 more
  1. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  2. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
  3. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  4. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  5. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  6. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
  7. 2019Deep Flow-Guided Video Inpaintingcited by 116
  8. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  9. 2019Deep Video Inpaintingcited by 109
  10. 2019Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGANcited by 87
  11. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  12. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
  13. 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
  14. 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 52
  15. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 49
  16. 2015Video Inpainting of Complex Scenescited by 41
  17. 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 39
  18. 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
  19. 2025ROSE: Remove Objects with Side Effects in Videoscited by 38
  20. 2024Generative Video Propagationcited by 36
  21. 2019An Internal Learning Approach to Video Inpaintingcited by 33
  22. 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 16
  23. 2023OmnimatteRF: Robust Omnimatte with 3D Background Modelingcited by 14
  24. 2025DCEdit: Dual-Level Controlled Image Editing via Precisely Localized Semanticscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing
  2. 2026YOSE: You Only Select Essential Tokens for Efficient DiT-based Video Object Removal
  3. 2026OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal
  4. 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
  5. 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting
  6. 2026Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translation
  7. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removal
  8. 2024ReMOVE: A Reference-free Metric for Object Erasure