ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing
Not on the map. Why?
Abstract (arXiv)
Current video editors can insert objects but often struggle to make them participate in interactions such as being picked up or manipulated. We introduce ALIVE, a framework that makes inserted objects "alive" through coherent interactions with the source video's contents, using an edited first frame and an instruction naming only the added object. We curate 35,800 editing pairs combining 3D-rendered, model-generated, and real-world videos with general editing pairs from ROSE. Each pair differs in the target object's presence while preserving the surrounding action, teaching editors coordinated object behavior and source preservation. We further train a vision-language model (VLM) to predict interaction guidance from the same inputs. We introduce the ALIVE-interaction benchmark to assess interaction fidelity, source preservation, and visual coherence using a unified VLM-based protocol, and evaluate on the general video object insertion benchmark. Without VLM guidance, ALIVE improves Overall over the strongest evaluated baseline by 43.9% and 4.4% on the two benchmarks, respectively. VLM-predicted guidance further improves the ALIVE-interaction score by 0.95 points without additional user inputs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion
- 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
- 2025InsertAnywhere: Geometrically Grounded and Optics-Aware Video Object Insertion
- 2026SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion
- 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
- 2026Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework
- 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
- 2026CoT-Edit: Let CoT Guide Instruction Video Editing