EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal
Not on the map. Why?
Abstract (arXiv)
Video object removal must eliminate not only the target object but also its induced effects while maintaining high-fidelity and spatiotemporally coherent restoration. Existing methods mainly learn object-effect correspondences implicitly from predefined effect categories and fixed data distributions, limiting their generalization to complex real-world scenes involving compositional effects, spatially detached or weakly correlated effects, long-tail physical phenomena, and dynamically evolving interactions. We propose EffectLearner, a semantic-reasoning-enhanced framework that combines a VLM-based Object-Effect Reasoner with a DiT-based Video Eraser. Guided by a structured effect-analysis prompt, the Reasoner performs cross-modal reasoning over a target-highlighted video and extracts compact effect-aware context, which guides the Video Eraser toward comprehensive object-effect removal. Motion-aware mask guidance and motion-consistency supervision further improve removal coverage and spatiotemporal stability under object motion and evolving scene dynamics. To fully exploit the framework in challenging real-world scenarios, we further construct EffectWorld, a paired video dataset specifically designed for complex object-induced effects, and introduce a progressive training curriculum that combines common supervision with complex-effect data. On the standard ROSE-Bench, EffectLearner outperforms existing baselines on most metrics and achieves clear advantages on both EffectWorld-Eval and the challenging EffectWorld-Wild, demonstrating its ability to deliver high-quality video object removal in complex real-world scenes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
22 of 35 references.
References · 22
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 162
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
- 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
- 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 40
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 34
10 more
- 2025ROSE: Remove Objects with Side Effects in Videoscited by 32
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimizationcited by 16
- 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasingcited by 12
- 2019VORNet: Spatio-temporally Consistent Video Inpainting for Object Removalcited by 11
- 2026VOID: Video Object and Interaction Deletioncited by 9
- 2026Object-WIPER : Training-Free Object and Associated Effect Removal in Videoscited by 5
- 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditionscited by 4
- 2026MoZoo:Unleashing Video Diffusion power in animal fur and muscle simulationcited by 1
- 2026DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preservercited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal
- 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
- 2026OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal
- 2026Interaction-Consistent Object Removal via MLLM-Based Reasoning
- 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal
- 2025EraseLoRA: MLLM-Driven Foreground Exclusion and Background Subtype Aggregation for Dataset-Free Object Removal
- 2025CrimEdit: Controllable Editing for Counterfactual Object Removal, Insertion, and Movement
- 2026Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translation