Get In Video: Add Anything You Want to the Video
Not on the map. Why?
Abstract (arXiv)
Video editing increasingly demands the ability to incorporate specific real-world instances into existing footage, yet current approaches fundamentally fail to capture the unique visual characteristics of particular subjects and ensure natural instance/scene interactions. We formalize this overlooked yet critical editing paradigm as "Get-In-Video Editing", where users provide reference images to precisely specify visual elements they wish to incorporate into videos. Addressing this task's dual challenges, severe training data scarcity and technical challenges in maintaining spatiotemporal coherence, we introduce three key contributions. First, we develop GetIn-1M dataset created through our automated Recognize-Track-Erase pipeline, which sequentially performs video captioning, salient instance identification, object detection, temporal tracking, and instance removal to generate high-quality video editing pairs with comprehensive annotations (reference image, tracking mask, instance prompt). Second, we present GetInVideo, a novel end-to-end framework that leverages a diffusion transformer architecture with 3D full attention to process reference images, condition videos, and masks simultaneously, maintaining temporal coherence, preserving visual identity, and ensuring natural scene interactions when integrating reference objects into videos. Finally, we establish GetInBench, the first comprehensive benchmark for Get-In-Video Editing scenario, demonstrating our approach's superior performance through extensive evaluations. Our work enables accessible, high-quality incorporation of specific real-world subjects into videos, significantly advancing personalized video editing capabilities.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 32 of its 46 references that are in the map. First posted on arXiv 8 Mar 2025.
Builds on
32 of 46 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
20 more
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 82
- 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
- 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 76
- 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Modelscited by 59
- 2024Diffusion Model-Based Video Editing: A Surveycited by 44
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2023DragVideo: Interactive Drag-style Video Editingcited by 40
- 2023MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generationcited by 26
- 2023Drag-A-Video: Non-rigid Video Editing with Point-based Interactioncited by 22
Built on by
Citing papers per year: 2025: 9; 2026: 3.
12 papers.
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 32
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
- 2025OmniV2V: Versatile Video Generation and Editing via Dynamic Content Manipulationcited by 19
- 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimizationcited by 16
- 2025Frame In-N-Out: Unbounded Controllable Image-to-Video Generationcited by 10
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
- 2025Video-GPT via Next Clip Diffusioncited by 8
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learningcited by 7
- 2025LoVoRA: Text-guided and Mask-free Video Object Removal and Addition with Learnable Object-aware Localizationcited by 5
- 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Frameworkcited by 3
- 2026Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertioncited by 0
- 2026Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editingcited by 0
- 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework22 May 2026
- 2026Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing22 May 2026
- 2026Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion6 Mar 2026
- 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimization18 Dec 2025
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning10 Dec 2025
- 2025LoVoRA: Text-guided and Mask-free Video Object Removal and Addition with Learnable Object-aware Localization2 Dec 2025
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidance9 Oct 2025
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment22 Sep 2025
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Models22 Sep 2025
- 2025OmniV2V: Versatile Video Generation and Editing via Dynamic Content Manipulation2 Jun 2025
- 2025Frame In-N-Out: Unbounded Controllable Image-to-Video Generation27 May 2025
- 2025Video-GPT via Next Clip Diffusion18 May 2025
Similar, not cited
Close in wording, no citation either way
- 2024Temporally Consistent Object Editing in Videos using Extended Attention
- 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
- 2023Edit-A-Video: Single Video Editing with Object-Aware Consistency
- 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing
- 2026VINCIE-NExT: Unlocking Video Editing from Images via In-Context Modeling
- 2025Zero-Shot Video Translation and Editing with Frame Spatial-Temporal Correspondence
- 2026OSVE: One Step Video Editing with One Step Diffusion Models
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models