mlsanityData to 14 Oct 2026

Controllable Video Object Insertion via Multi-View Priors

arXiv 2604.14556 ↗First posted 16 Apr 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Video object insertion places a user-specified object in an existing dynamic scene. Existing methods typically condition generation on text or a single reference image. Consequently, object appearance is underconstrained under viewpoint changes, often leading to identity drift, incorrect foreground-background layering, boundary artifacts, and temporal flickering. In this paper, we propose a video object insertion framework that incorporates multi-view object priors to address these limitations. The framework lifts a 2D reference image into a multi-view representation and uses view-consistent conditioning to provide stable identity guidance and view-adaptive appearance cues. A quality-aware weighting mechanism reduces the influence of noisy or imperfect reconstructed views. We further introduce an Integration-Aware Consistency Module that promotes plausible occlusion, clean boundaries, and temporal continuity. Experiments demonstrate that the proposed framework improves visual quality, controllability, identity consistency, and foreground-background integration for video object insertion compared to the baseline methods. Project page: https://polarisxq.github.io/MOVI/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 58 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

42 of 58 references.

References · 42

  1. 2020Denoising Diffusion Implicit Modelscited by 9,781
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2025Qwen-Image Technical Reportcited by 1,044
  7. 2019Panoptic Feature Pyramid Networkscited by 645
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  9. 2025VACE: All-in-One Video Creation and Editingcited by 479
  10. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  11. 2019Video Instance Segmentationcited by 393
  12. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
30 more
  1. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  2. 2023Photorealistic Video Generation with Diffusion Modelscited by 306
  3. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  4. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  5. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234
  6. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  7. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  8. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  9. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  10. 2019Deep Flow-Guided Video Inpaintingcited by 116
  11. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
  12. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
  13. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  14. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 82
  15. 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
  16. 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 62
  17. 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
  18. 2023GeoDiffusion: Text-Prompted Geometric Control for Object Detection Data Generationcited by 56
  19. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 50
  20. 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesiscited by 39
  21. 2025Uni4D: Unifying Visual Foundation Models for 4D Modeling from a Single Videocited by 29
  22. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 28
  23. 2022Error Compensation Framework for Flow-Guided Video Inpaintingcited by 20
  24. 2023SAVE: Protagonist Diversification with Structure Agnostic Video Editingcited by 15
  25. 2025MTV-Inpaint: Multi-Task Long Video Inpaintingcited by 14
  26. 2025DynVFX: Augmenting Real Videos with Dynamic Contentcited by 9
  27. 2025GenCompositor: Generative Video Compositing with Diffusion Transformercited by 9
  28. 2024Semantically Consistent Video Inpainting with Conditional Diffusion Modelscited by 8
  29. 2026MVHOI: Bridge Multi-view Condition to Complex Human-Object Interaction Video Reenactment via 3D Foundation Modelcited by 3
  30. 2025From Gallery to Wrist: Realistic 3D Bracelet Insertion in Videoscited by 1

Built on by

Not cited yet.