EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editing
Not on the map. Why?
Abstract (arXiv)
High-fidelity generative video editing has seen significant quality improvements by leveraging pre-trained video foundation models. However, their computational cost is a major bottleneck, as they are often designed to inefficiently process the full video context regardless of the inpainting mask's size, even for sparse, localized edits. In this paper, we introduce EditCtrl, an efficient video inpainting control framework that focuses computation only where it is needed. Our approach features a novel local video context module that operates solely on masked tokens, yielding a computational cost proportional to the edit size. This local-first generation is then guided by a lightweight temporal global context embedder that ensures video-wide context consistency with minimal overhead. Not only is EditCtrl 10 times more compute efficient than state-of-the-art generative editing methods, it even improves editing quality compared to methods designed with full-attention. Finally, we showcase how EditCtrl unlocks new capabilities, including multi-region editing with text prompts and autoregressive content propagation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 57 of its 62 references that are in the map. First posted on arXiv 16 Feb 2026.
Builds on
57 of 62 references.
References · 57
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022Token Merging: Your ViT But Fastercited by 995
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
38 more
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 111
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 100
- 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 95
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 91
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
- 2024Multistep Consistency Modelscited by 67
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
- 2024MarDini: Masked Autoregressive Diffusion for Video Generation at Scalecited by 49
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesiscited by 48
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relightingcited by 38
- 2024Generative Video Propagationcited by 36
- 2024Object-Centric Diffusion for Efficient Video Editingcited by 31
- 2023Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Modelscited by 29
- 2024MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priorscited by 28
- 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
- 2025MatAnyone: Stable Video Matting with Consistent Memory Propagationcited by 24
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditionscited by 4
- 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Modelscited by 0
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editingcited by 0
- 2026MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generationcited by 0
- 2026MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generation7 Aug 2026
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editing22 Jun 2026
- 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Models17 Jun 2026
- 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditions10 Mar 2026