mlsanityData to 7 Oct 2026

InsertAnywhere: Geometrically Grounded and Optics-Aware Video Object Insertion

arXiv 2512.17504 ↗First posted 19 Dec 2025cs.CV cs.AIcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent advances in diffusion models have enabled impressive video editing capabilities, yet production-grade Video Object Insertion (VOI) remains challenging due to inadequate 4D scene understanding and a lack of proper optical interactions, such as shadows and reflections. To address these limitations, we present InsertAnywhere, a comprehensive VOI framework that achieves geometrically grounded object placement and optics-aware video synthesis. Our approach first leverages a 4D-aware mask generation module that allows users to anchor an object's 3D pose in a single frame. The framework automatically propagates this placement across the video, accurately handling local scene dynamics and occlusions. To synthesize realistic physical lighting interactions, we introduce Optics-Aware Representation Alignment, a novel strategy that utilizes an extended mask to guide feature extraction, enabling optical effects to seamlessly extend beyond the inserted object's boundary. Finally, to overcome the lack of training data for such phenomena, we construct and open-source ROSE++, a specialized quadruplet dataset tailored for the supervised learning of optical effects. Extensive experiments demonstrate that InsertAnywhere produces geometrically plausible and photometrically realistic insertions in complex real-world scenarios, significantly outperforming existing research and commercial generative tools.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 26 of its 28 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

26 of 28 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting11 Mar
  2. 2024InVi: Object Insertion In Videos Using Off-the-Shelf Diffusion Models15 Jul

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Segment Anythingcited by 8,158
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  9. 2025VACE: All-in-One Video Creation and Editingcited by 467
  10. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  11. 2023Tracking Anything with Decoupled Video Segmentationcited by 197
  12. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
12 more
  1. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
  2. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
  3. 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
  4. 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
  5. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  6. 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
  7. 2024Generative Video Propagationcited by 36
  8. 2025ROSE: Remove Objects with Side Effects in Videoscited by 32
  9. 2025Uni4D: Unifying Visual Foundation Models for 4D Modeling from a Single Videocited by 27
  10. 2024Anything in Any Scene: Photorealistic Video Object Insertioncited by 9
  11. 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
  12. 2025DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Imagecited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion
  2. 2026ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing
  3. 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework
  4. 20253D-Fixup: Advancing Photo Editing with 3D Priors
  5. 2026Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion
  6. 2025Shape-for-Motion: Precise and Consistent Video Editing with 3D Proxy
  7. 2026InsertFuse: A Unified Framework for Multi-Category Reference-Guided Image Insertion
  8. 2025Insert Anything: Image Insertion via In-Context Editing in DiT