When to Lock Attention: Training-Free KV Control in Video Diffusion
On the map: Diffusion models → Video generation
Abstract (arXiv)
Maintaining background consistency while enhancing foreground quality remains a core challenge in video editing. Injecting full-image information often leads to background artifacts, whereas rigid background locking severely constrains the model's capacity for foreground generation. To address this issue, we propose KV-Lock, a training-free framework tailored for DiT-based video diffusion models. Our core insight is that the hallucination metric (variance of denoising prediction) directly quantifies generation diversity, which is inherently linked to the classifier-free guidance (CFG) scale. Building upon this, KV-Lock leverages diffusion hallucination detection to dynamically schedule two key components: the fusion ratio between cached background key-values (KVs) and newly generated KVs, and the CFG scale. When hallucination risk is detected, KV-Lock strengthens background KV locking and simultaneously amplifies conditional guidance for foreground generation, thereby mitigating artifacts and improving generation fidelity. As a training-free, plug-and-play module, KV-Lock can be easily integrated into any pre-trained DiT-based models. Extensive experiments validate that our method outperforms existing approaches in improved foreground quality with high background fidelity across various video editing tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 63 of its 68 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
63 of 68 references.
Closest ancestors · 22
Same direction, newest first
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
- 2025DiTraj: training-free trajectory control for video diffusion transformer26 Sep
- 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation24 May
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation24 Dec
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul
- 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Models24 Jun
- 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slices20 May
10 more
- 2024Motion-Zero: Zero-Shot Moving Object Control Framework for Diffusion-Based Video Generation18 Jan
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence4 Dec
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models28 Nov
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Models12 Oct
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing9 Oct
- 2023Control-A-Video: Controllable Text-to-Video Diffusion Models with Motion Prior and Reward Feedback Learning23 May
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
- 2022Video Diffusion Models7 Apr
Other references · 41
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
29 more
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
- 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
- 2023Cache Me if You Can: Accelerating Diffusion Models through Block Cachingcited by 149
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
- 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 107
- 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
- 2024Understanding Hallucinations in Diffusion Models through Mode Interpolationcited by 87
- 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editingcited by 66
- 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 47
- 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Modelscited by 47
- 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
- 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 27
- 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 24
- 2024Gender Bias in Text-to-Video Generation Models: A case study of Soracited by 8
- 2025Block Cascading: Training Free Acceleration of Block-Causal Video Modelscited by 5
- 2025ProEdit: Inversion-based Editing From Prompts Done Rightcited by 5
- 2026PILD: Physics-Informed Learning via Diffusioncited by 2
- 2026FAIRT2V: Training-Free Debiasing for Text-to-Video Diffusion Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Physics in 2-Steps: Locking Motion Priors Before Visual Refinement Erases Them
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation
- 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
- 2026In-Distribution Forcing for Long Video Generation at Test Time
- 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
- 2024FreeMask: Rethinking the Importance of Attention Masks for Zero-Shot Video Editing
- 2025Frame Guidance: Training-Free Guidance for Frame-Level Control in Video Diffusion Models