mlsanityData to 14 Oct 2026

Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework

arXiv 2605.23891 ↗First posted 22 May 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Mask-free video object insertion has emerged as a challenging task, requiring harmonious integration of reference objects into source videos. However, existing methods struggle when references exhibit severe stylistic domain gaps with the source scene. To overcome this, we propose textitSmart-Insertion-V, an end-to-end Dual-Stream framework that concurrently conducts video insertion and image style transfer. Within this framework, the image stream synchronously guides the video generation process, while a Closed-loop Feedback mechanism is further incorporated to ensure robust insertion. Inevitably, integrating these diverse conditioning signals results in feature entanglement and style leakage. To tackle this issue, we design Dual-World-View RoPE to distinguish different signals via spatial-temporal offsets without incurring heavy training overhead. Furthermore, to facilitate spatial grounding and stylistic adaptation, we introduce a Decoupled Guidance Module that leverages a Vision-Language Model for semantic reasoning while preserving original temporal guidance with native text encoder. To bridge data gap for harmonious reference insertion task, we propose a data curation pipeline and will release an open-source dataset. Experiments demonstrate that our method can insert objects into plausible positions while achieving the most harmonious results.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

42 of 64 references.

References · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  7. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  8. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  10. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  11. 2025VACE: All-in-One Video Creation and Editingcited by 479
  12. 2024OmniGen: Unified Image Generationcited by 394
30 more
  1. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  2. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  3. 2023A Survey on Video Diffusion Modelscited by 206
  4. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  5. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  6. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  7. 2017Deep Image Harmonizationcited by 120
  8. 2025Controllable Video Generation: A Surveycited by 98
  9. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  10. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  11. 2025UNIC: Unified In-Context Video Editingcited by 55
  12. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
  13. 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
  14. 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
  15. 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
  16. 2023Vision Transformer with Quadrangle Attentioncited by 46
  17. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
  18. 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
  19. 2023DragVideo: Interactive Drag-style Video Editingcited by 40
  20. 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
  21. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
  22. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 28
  23. 2025Get In Video: Add Anything You Want to the Videocited by 12
  24. 2024Anything in Any Scene: Photorealistic Video Object Insertioncited by 9
  25. 2024Towards Better Text-to-Image Generation Alignment via Attention Modulationcited by 9
  26. 2025Shape-for-Motion: Precise and Consistent Video Editing with 3D Proxycited by 9
  27. 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
  28. 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editingcited by 8
  29. 2025DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Imagecited by 6
  30. 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025InsertAnywhere: Geometrically Grounded and Optics-Aware Video Object Insertion
  2. 2026SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion
  3. 2026Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion
  4. 2026ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing
  5. 2026InsertFuse: A Unified Framework for Multi-Category Reference-Guided Image Insertion
  6. 2025Insert Anything: Image Insertion via In-Context Editing in DiT
  7. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructions
  8. 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos