Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework
Not on the map. Why?
Abstract (arXiv)
Mask-free video object insertion has emerged as a challenging task, requiring harmonious integration of reference objects into source videos. However, existing methods struggle when references exhibit severe stylistic domain gaps with the source scene. To overcome this, we propose textitSmart-Insertion-V, an end-to-end Dual-Stream framework that concurrently conducts video insertion and image style transfer. Within this framework, the image stream synchronously guides the video generation process, while a Closed-loop Feedback mechanism is further incorporated to ensure robust insertion. Inevitably, integrating these diverse conditioning signals results in feature entanglement and style leakage. To tackle this issue, we design Dual-World-View RoPE to distinguish different signals via spatial-temporal offsets without incurring heavy training overhead. Furthermore, to facilitate spatial grounding and stylistic adaptation, we introduce a Decoupled Guidance Module that leverages a Vision-Language Model for semantic reasoning while preserving original temporal guidance with native text encoder. To bridge data gap for harmonious reference insertion task, we propose a data curation pipeline and will release an open-source dataset. Experiments demonstrate that our method can insert objects into plausible positions while achieving the most harmonious results.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
42 of 64 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2024OmniGen: Unified Image Generationcited by 394
30 more
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2023A Survey on Video Diffusion Modelscited by 206
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2017Deep Image Harmonizationcited by 120
- 2025Controllable Video Generation: A Surveycited by 98
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
- 2023Vision Transformer with Quadrangle Attentioncited by 46
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2023DragVideo: Interactive Drag-style Video Editingcited by 40
- 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 28
- 2025Get In Video: Add Anything You Want to the Videocited by 12
- 2024Anything in Any Scene: Photorealistic Video Object Insertioncited by 9
- 2024Towards Better Text-to-Image Generation Alignment via Attention Modulationcited by 9
- 2025Shape-for-Motion: Precise and Consistent Video Editing with 3D Proxycited by 9
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
- 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editingcited by 8
- 2025DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Imagecited by 6
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025InsertAnywhere: Geometrically Grounded and Optics-Aware Video Object Insertion
- 2026SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion
- 2026Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion
- 2026ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing
- 2026InsertFuse: A Unified Framework for Multi-Category Reference-Guided Image Insertion
- 2025Insert Anything: Image Insertion via In-Context Editing in DiT
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructions
- 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos