mlsanityData to 7 Oct 2026

When to Lock Attention: Training-Free KV Control in Video Diffusion

arXiv 2603.09657 ↗First posted 10 Mar 2026cs.CV cs.AI cs.ETcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Maintaining background consistency while enhancing foreground quality remains a core challenge in video editing. Injecting full-image information often leads to background artifacts, whereas rigid background locking severely constrains the model's capacity for foreground generation. To address this issue, we propose KV-Lock, a training-free framework tailored for DiT-based video diffusion models. Our core insight is that the hallucination metric (variance of denoising prediction) directly quantifies generation diversity, which is inherently linked to the classifier-free guidance (CFG) scale. Building upon this, KV-Lock leverages diffusion hallucination detection to dynamically schedule two key components: the fusion ratio between cached background key-values (KVs) and newly generated KVs, and the CFG scale. When hallucination risk is detected, KV-Lock strengthens background KV locking and simultaneously amplifies conditional guidance for foreground generation, thereby mitigating artifacts and improving generation fidelity. As a training-free, plug-and-play module, KV-Lock can be easily integrated into any pre-trained DiT-based models. Extensive experiments validate that our method outperforms existing approaches in improved foreground quality with high background fidelity across various video editing tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 63 of its 68 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

63 of 68 references.

Closest ancestors · 22

Same direction, newest first

  1. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
  2. 2025DiTraj: training-free trajectory control for video diffusion transformer26 Sep
  3. 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation24 May
  4. 2025VACE: All-in-One Video Creation and Editing10 Mar
  5. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
  6. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation24 Dec
  7. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
  8. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  10. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul
  11. 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Models24 Jun
  12. 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slices20 May
10 more
  1. 2024Motion-Zero: Zero-Shot Moving Object Control Framework for Diffusion-Based Video Generation18 Jan
  2. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence4 Dec
  3. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models28 Nov
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  5. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Models12 Oct
  6. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing9 Oct
  7. 2023Control-A-Video: Controllable Text-to-Video Diffusion Models with Motion Prior and Reward Feedback Learning23 May
  8. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
  10. 2022Video Diffusion Models7 Apr

Other references · 41

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  12. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
29 more
  1. 2022On Distillation of Guided Diffusion Modelscited by 721
  2. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  3. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  4. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  5. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  6. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  7. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
  8. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
  9. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  10. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  11. 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
  12. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  13. 2023Cache Me if You Can: Accelerating Diffusion Models through Block Cachingcited by 149
  14. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  15. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
  16. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 107
  17. 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
  18. 2024Understanding Hallucinations in Diffusion Models through Mode Interpolationcited by 87
  19. 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editingcited by 66
  20. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 47
  21. 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Modelscited by 47
  22. 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
  23. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 27
  24. 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 24
  25. 2024Gender Bias in Text-to-Video Generation Models: A case study of Soracited by 8
  26. 2025Block Cascading: Training Free Acceleration of Block-Causal Video Modelscited by 5
  27. 2025ProEdit: Inversion-based Editing From Prompts Done Rightcited by 5
  28. 2026PILD: Physics-Informed Learning via Diffusioncited by 2
  29. 2026FAIRT2V: Training-Free Debiasing for Text-to-Video Diffusion Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physics in 2-Steps: Locking Motion Priors Before Visual Refinement Erases Them
  2. 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling
  3. 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation
  4. 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
  5. 2026In-Distribution Forcing for Long Video Generation at Test Time
  6. 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
  7. 2024FreeMask: Rethinking the Importance of Attention Masks for Zero-Shot Video Editing
  8. 2025Frame Guidance: Training-Free Guidance for Frame-Level Control in Video Diffusion Models