VOID: Video Object and Interaction Deletion
Not on the map. Why?
Abstract (arXiv)
Existing video object removal methods excel at inpainting content "behind" the object and correcting appearance-level artifacts such as shadows and reflections. However, when the removed object has more significant interactions, such as collisions with other objects, current models fail to correct them and produce implausible results. We present VOID, a video object removal framework designed to perform physically-plausible inpainting in these complex scenarios. To train the model, we generate a new paired dataset of counterfactual object removals using Kubric and HUMOTO, where removing an object requires altering downstream physical interactions. During inference, a vision-language model identifies regions of the scene affected by the removed object. These regions are then used to guide a video diffusion model that generates physically consistent counterfactual outcomes. Experiments on both synthetic and real data show that our approach better preserves consistent scene dynamics after object removal compared to prior video object removal methods. We hope this framework sheds light on how to make video editing models better simulators of the world through high-level causal reasoning.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 39 of its 45 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
39 of 45 references.
References · 39
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
- 2022Kubric: A scalable dataset generatorcited by 381
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
27 more
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2025Do generative video models understand physical principles?cited by 161
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
- 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 134
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 82
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
- 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generationcited by 44
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 40
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2025ROSE: Remove Objects with Side Effects in Videoscited by 38
- 2025HUMOTO: A 4D Dataset of Mocap Human Object Interactionscited by 31
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibilitycited by 18
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 16
- 2023OmnimatteRF: Robust Omnimatte with 3D Background Modelingcited by 14
- 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinementcited by 14
- 2025What Happens Next? Anticipating Future Motion by Generating Point Trajectoriescited by 10
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Modelscited by 8
- 2026Object-WIPER : Training-Free Object and Associated Effect Removal in Videoscited by 6
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 4
- 2024InTraGen: Trajectory-controlled Video Generation for Object Interactionscited by 3
- 2025LangDriveCTRL: Natural Language Controllable Driving Scene Editing with Multi-modal Agentscited by 3
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
- 2026Physics-Aware Video Instance Removal Benchmarkcited by 3
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editingcited by 2
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentationcited by 1
- 2026DexAgent: An Agentic Human2Sim2Robot Framework for Dexterous Manipulation with Self-Evolving Tool Librarycited by 1
- 2026AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidancecited by 0
- 2026EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removalcited by 0
- 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removalcited by 0
- 2026Reimagine Video Dynamicscited by 0
- 2026Reimagine Video Dynamics29 Sep 2026
- 2026DexAgent: An Agentic Human2Sim2Robot Framework for Dexterous Manipulation with Self-Evolving Tool Library28 Sep 2026
- 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal15 Sep 2026
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing16 Aug 2026
- 2026EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal6 Aug 2026
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentation18 Jun 2026
- 2026AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance31 May 2026
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects17 Apr 2026
- 2026Physics-Aware Video Instance Removal Benchmark7 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal
- 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing
- 2025CrimEdit: Controllable Editing for Counterfactual Object Removal, Insertion, and Movement
- 2024ReMOVE: A Reference-free Metric for Object Erasure
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion
- 2026OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting