From Understanding to Erasing: Towards Complete and Stable Video Object Removal
Not on the map. Why?
Abstract (arXiv)
Video object removal aims to erase target objects while reconstructing visually plausible and temporally coherent content. However, target objects often induce shadows, reflections, illumination changes and other effects that extend beyond the provided mask, making conventional mask-conditioned completion prone to visible residuals. We therefore formulate side-effect-aware object removal as an understanding-guided process that integrates object--effect relations, affected-region localization, and context-aware reconstruction. Specifically, we introduce Object-Induced Relation Distillation to transfer token-level object--effect relations from a pretrained vision foundation model to the video diffusion model. We then design Object-aware Framewise Context Cross-Attention to combine target-object semantics with per-frame background context for removal and reconstruction, and propose Attention-guided Region Localization to derive a soft spatial prior over the target object and its affected regions. Extensive experiments across multiple benchmarks demonstrate that our method achieves more complete object-and-effect removal and outperforms existing approaches in removal quality, side-effect suppression, and temporal consistency.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 59 of its 67 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
59 of 67 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
- 2018Learning Blind Video Temporal Consistencycited by 247
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 162
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2020Flow-edge Guided Video Completioncited by 104
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2019Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGANcited by 85
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2018Video Inpainting by Jointly Learning Temporal Structure and Spatial Detailscited by 57
- 2019Copy-and-Paste Networks for Deep Video Inpaintingcited by 57
- 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2020Short-Term and Long-Term Context Aggregation Network for Video Inpaintingcited by 34
- 2019An Internal Learning Approach to Video Inpaintingcited by 33
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
- 2026EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal
- 2026VOID: Video Object and Interaction Deletion
- 2026Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translation
- 2025EraseLoRA: MLLM-Driven Foreground Exclusion and Background Subtype Aggregation for Dataset-Free Object Removal
- 2026PANDORA: Pixel-wise Attention Dissolution and Latent Guidance for Zero-Shot Object Removal
- 2024ReMOVE: A Reference-free Metric for Object Erasure
- 2026OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal