MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing
Not on the map. Why?
Abstract (arXiv)
Multi subject video editing modifies designated subjects while preserving non target content, but faces cross subject attribute leakage, and occlusion ambiguity. Existing approaches rely on masks and struggle to distinguish overlapping subjects or ensure consistent generation. To address these limitations, we propose MDN-Control, a training free framework jointly controlling target localization, occlusion geometry, and appearance initialization. Specifically, mask-guided localization provides consistent target localization, while depth-aware occlusion control resolves ambiguous boundaries between overlapping subjects. We further introduce noise latent prompting, which retrieves Gaussian initializations from a noise library for prompt relevant priors. Experiments on MSVBench show that MDN-Control achieves the lowest CM-Err and the highest Q-Edit, while maintaining competitive text alignment and temporal consistency, demonstrating the effectiveness of combining spatial, geometric, and latent priors for multi subject video editing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 24 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
23 of 24 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2022Video Diffusion Modelscited by 2,305
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2024Depth Anything V2cited by 1,422
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2025VACE: All-in-One Video Creation and Editingcited by 479
11 more
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 285
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2024The Silent Assistant: NoiseQuery as Implicit Guidance for Goal-Driven Image Generationcited by 14
- 2024FreeDiff: Progressive Frequency Truncation for Image Editing with Diffusion Modelscited by 13
- 2025ASTRA: Let Arbitrary Subjects Transform in Video Editingcited by 6
Built on by
Not cited yet.