mlsanityData to 14 Oct 2026

MAKIMA: Tuning-free Multi-Attribute Open-domain Video Editing via Mask-Guided Attention Modulation

arXiv 2412.19978 ↗First posted 28 Dec 2024cs.CVcited by 2

On the map: Diffusion models → Video generation

Abstract (arXiv)

Diffusion-based text-to-image (T2I) models have demonstrated remarkable results in global video editing tasks. However, their focus is primarily on global video modifications, and achieving desired attribute-specific changes remains a challenging task, specifically in multi-attribute editing (MAE) in video. Contemporary video editing approaches either require extensive fine-tuning or rely on additional networks (such as ControlNet) for modeling multi-object appearances, yet they remain in their infancy, offering only coarse-grained MAE solutions. In this paper, we present MAKIMA, a tuning-free MAE framework built upon pretrained T2I models for open-domain video editing. Our approach preserves video structure and appearance information by incorporating attention maps and features from the inversion process during denoising. To facilitate precise editing of multiple attributes, we introduce mask-guided attention modulation, enhancing correlations between spatially corresponding tokens and suppressing cross-attribute interference in both self-attention and cross-attention layers. To balance video frame generation quality and efficiency, we implement consistent feature propagation, which generates frame sequences by editing keyframes and propagating their features throughout the sequence. Extensive experiments demonstrate that MAKIMA outperforms existing baselines in open-domain multi-attribute video editing tasks, achieving superior results in both editing accuracy and temporal consistency while maintaining computational efficiency.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 45 references that are in the map. First posted on arXiv 28 Dec 2024.

Builds on

40 of 45 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024EVA: Zero-shot Accurate Attributes and Multi-Object Video Editing24 Mar
  2. 2024FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation19 Mar
  3. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  4. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing9 Oct
  5. 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Models2 Oct
  6. 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
  7. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  8. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec

Other references · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  9. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
19 more
  1. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  3. 2022Diffusion Models in Vision: A Surveycited by 1,015
  4. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  5. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  6. 2016Generative Adversarial Text to Image Synthesiscited by 735
  7. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  8. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  9. 2023Zero-shot Image-to-Image Translationcited by 505
  10. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  11. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  12. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  13. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  14. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
  15. 2023Any-to-Any Generation via Composable Diffusioncited by 204
  16. 2019Controllable Text-to-Image Generationcited by 187
  17. 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
  18. 2022BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotationcited by 54
  19. 2024HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Modelscited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023InFusion: Inject and Attention Fusion for Multi Concept Zero-Shot Text-based Video Editing
  2. 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing
  3. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistency
  4. 2024FreeMask: Rethinking the Importance of Attention Masks for Zero-Shot Video Editing
  5. 2024Temporally Consistent Object Editing in Videos using Extended Attention
  6. 2023RealCraft: Attention Control as A Tool for Zero-Shot Consistent Video Editing
  7. 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editing
  8. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning