DreamSwapV: Mask-guided Subject Swapping for Any Customized Video Editing
Not on the map. Why?
Abstract (arXiv)
With the rapid progress of video generation, demand for customized video editing is surging, where subject swapping constitutes a key component yet remains under-explored. Prevailing swapping approaches either specialize in narrow domains--such as human-body animation or hand-object interaction--or rely on some indirect editing paradigm or ambiguous text prompts that compromise final fidelity. In this paper, we propose DreamSwapV, a mask-guided, subject-agnostic, end-to-end framework that swaps any subject in any video for customization with a user-specified mask and reference image. To inject fine-grained guidance, we introduce multiple conditions and a dedicated condition fusion module that integrates them efficiently. In addition, an adaptive mask strategy is designed to accommodate subjects of varying scales and attributes, further improving interactions between the swapped subject and its surrounding context. Through our elaborate two-phase dataset construction and training scheme, our DreamSwapV outperforms existing methods, as validated by comprehensive experiments on VBench indicators and our first introduced DreamSwapV-Benchmark.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
35 of 42 references.
References · 35
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
23 more
- 2016Generating Videos with Scene Dynamicscited by 376
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 102
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 64
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 61
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
- 2024AnchorCrafter: Animate Cyber-Anchors Selling Your Products via Human-Object Interacting Video Generationcited by 26
- 2023ControlVideo: Conditional Control for One-shot Text-driven Video Editing and Beyondcited by 22
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 22
Built on by
Not cited yet.