MAKIMA: Tuning-free Multi-Attribute Open-domain Video Editing via Mask-Guided Attention Modulation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Diffusion-based text-to-image (T2I) models have demonstrated remarkable results in global video editing tasks. However, their focus is primarily on global video modifications, and achieving desired attribute-specific changes remains a challenging task, specifically in multi-attribute editing (MAE) in video. Contemporary video editing approaches either require extensive fine-tuning or rely on additional networks (such as ControlNet) for modeling multi-object appearances, yet they remain in their infancy, offering only coarse-grained MAE solutions. In this paper, we present MAKIMA, a tuning-free MAE framework built upon pretrained T2I models for open-domain video editing. Our approach preserves video structure and appearance information by incorporating attention maps and features from the inversion process during denoising. To facilitate precise editing of multiple attributes, we introduce mask-guided attention modulation, enhancing correlations between spatially corresponding tokens and suppressing cross-attribute interference in both self-attention and cross-attention layers. To balance video frame generation quality and efficiency, we implement consistent feature propagation, which generates frame sequences by editing keyframes and propagating their features throughout the sequence. Extensive experiments demonstrate that MAKIMA outperforms existing baselines in open-domain multi-attribute video editing tasks, achieving superior results in both editing accuracy and temporal consistency while maintaining computational efficiency.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 45 references that are in the map. First posted on arXiv 28 Dec 2024.
Builds on
40 of 45 references.
Closest ancestors · 9
Same direction, newest first
- 2024EVA: Zero-shot Accurate Attributes and Multi-Object Video Editing24 Mar
- 2024FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation19 Mar
- 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing9 Oct
- 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Models2 Oct
- 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
Other references · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
19 more
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
- 2023Any-to-Any Generation via Composable Diffusioncited by 204
- 2019Controllable Text-to-Image Generationcited by 187
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
- 2022BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotationcited by 54
- 2024HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Modelscited by 20
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023InFusion: Inject and Attention Fusion for Multi Concept Zero-Shot Text-based Video Editing
- 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing
- 2023Edit-A-Video: Single Video Editing with Object-Aware Consistency
- 2024FreeMask: Rethinking the Importance of Attention Masks for Zero-Shot Video Editing
- 2024Temporally Consistent Object Editing in Videos using Extended Attention
- 2023RealCraft: Attention Control as A Tool for Zero-Shot Consistent Video Editing
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editing
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning