Object-WIPER : Training-Free Object and Associated Effect Removal in Videos
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce Object-WIPER, a training-free framework for removing dynamic objects and their associated visual effects from videos, and inpainting them with semantically consistent and temporally coherent content. Our approach leverages a pre-trained text-to-video diffusion transformer (DiT). Given an input video, a user-provided object mask, and query tokens describing the target object and its effects, we localize relevant visual tokens via visual-text cross-attention and visual self-attention. This produces an intermediate effect mask that we fuse with the user mask to obtain a final foreground token mask to replace. We first invert the video through the DiT to obtain structured noise, then reinitialize the masked tokens with Gaussian noise while preserving background tokens. During denoising, we copy values for the background tokens saved during inversion to maintain scene fidelity. To address the lack of suitable evaluation, we introduce a new object removal metric that rewards temporal consistency among foreground tokens across consecutive frames, coherence between foreground and background tokens within each frame, and dissimilarity between the input and output foreground tokens. Experiments on DAVIS and a newly curated real-world associated effect benchmark (WIPER-Bench) show that Object-WIPER surpasses both training-based and training-free baselines in terms of the metric, achieving clean removal and temporally stable reconstruction without any retraining. Our new benchmark, source code, and pre-trained models will be publicly available.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 10 Jan 2026.
Builds on
36 of 46 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025DINOv3cited by 1,414
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
24 more
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2019Deep Video Inpaintingcited by 109
- 2019Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGANcited by 87
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 52
- 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 49
- 2015Video Inpainting of Complex Scenescited by 41
- 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 39
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2025ROSE: Remove Objects with Side Effects in Videoscited by 38
- 2024Generative Video Propagationcited by 36
- 2019An Internal Learning Approach to Video Inpaintingcited by 33
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 16
- 2023OmnimatteRF: Robust Omnimatte with 3D Background Modelingcited by 14
- 2025DCEdit: Dual-Level Controlled Image Editing via Precisely Localized Semanticscited by 9
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026VOID: Video Object and Interaction Deletioncited by 9
- 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditionscited by 5
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removalcited by 3
- 2026PROVE: A Perceptual RemOVal cohErence Benchmark for Visual Mediacited by 2
- 2026EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removalcited by 0
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generationcited by 0
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation30 Sep 2026
- 2026EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal6 Aug 2026
- 2026PROVE: A Perceptual RemOVal cohErence Benchmark for Visual Media14 May 2026
- 2026VOID: Video Object and Interaction Deletion2 Apr 2026
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal2 Apr 2026
- 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditions10 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing
- 2026YOSE: You Only Select Essential Tokens for Efficient DiT-based Video Object Removal
- 2026OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal
- 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
- 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting
- 2026Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translation
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removal
- 2024ReMOVE: A Reference-free Metric for Object Erasure