MagicEdit: High-Fidelity and Temporally Coherent Video Editing
Not on the map. Why?
Cited by 39 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this report, we present MagicEdit, a surprisingly simple yet effective solution to the text-guided video editing task. We found that high-fidelity and temporally coherent video-to-video translation can be achieved by explicitly disentangling the learning of content, structure and motion signals during training. This is in contradict to most existing methods which attempt to jointly model both the appearance and temporal representation within a single framework, which we argue, would lead to degradation in per-frame quality. Despite its simplicity, we show that MagicEdit supports various downstream video editing tasks, including video stylization, local editing, video-MagicMix and video outpainting.
Key facts. Cited by 75 papers in the map (data through 7 Oct 2026). Builds on 19 of its 19 references that are in the map. First posted on arXiv 28 Aug 2023.
Builds on
19 of 19 references.
References · 19
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
7 more
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 135
- 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 65
- 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
Built on by
Citing papers per year: 2023: 16; 2024: 30; 2025: 19; 2026: 10.
75 papers.
Sort:
By area:
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2023A Survey on Video Diffusion Modelscited by 203
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 113
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 95
38 more
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 81
- 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 80
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2023LivePhoto: Real Image Animation with Text-guided Motion Controlcited by 44
- 2024Diffusion Model-Based Video Editing: A Surveycited by 44
- 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 42
- 2024Mora: Enabling Generalist Video Generation via A Multi-Agent Frameworkcited by 41
- 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 39
- 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
- 2024Motion Inversion for Video Customizationcited by 30
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
- 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 24
- 2025Generative Video Motion Editing with 3D Point Trackscited by 21
- 2023BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Modelscited by 19
- 2023Fine-grained Controllable Video Generation via Object Appearance and Contextcited by 18
- 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
- 2023A Video is Worth 256 Bases: Spatial-Temporal Expectation-Maximization Inversion for Zero-Shot Video Editingcited by 14
- 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applicationscited by 14
- 2025SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusioncited by 12
- 2025Get In Video: Add Anything You Want to the Videocited by 12
- 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
- 2023MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformerscited by 11
- 2024GenRec: Unifying Video Generation and Recognition with Diffusion Modelscited by 11
- 2024PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Controlcited by 10
- 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimizationcited by 9
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
- 2023Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Methodcited by 8
- 2024MVOC: a training-free multiple video object composition method with diffusion modelscited by 8
- 2025Visual Prompting for One-shot Controllable Video Editing without Inversioncited by 8
- 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editingcited by 8
50 most cited of 75 All 75 (JSON)
- 2026Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomy28 Sep 2026
- 2026AnyTalk: Speech Animation for Arbitrary Characters Leveraging a Video Generation Model17 Aug 2026
- 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications28 Jul 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
- 2026AVControl: Efficient Framework for Training Audio-Visual Controls25 Mar 2026
- 2026Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion6 Mar 2026
- 2026FlexAM: Flexible Appearance-Motion Decomposition for Versatile Video Generation Control13 Feb 2026
- 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editing10 Feb 2026
- 2026SnapGen++: Unleashing Diffusion Transformers for Efficient High-Fidelity Image Generation on Edge Devices13 Jan 2026
- 2025Generative Video Motion Editing with 3D Point Tracks1 Dec 2025
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation21 Oct 2025
38 more
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videos9 Oct 2025
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution9 Oct 2025
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Models22 Sep 2025
- 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization20 Aug 2025
- 2025VideoGuard: Protecting Video Content from Unauthorized Editing5 Aug 2025
- 2025Good Noise Makes Good Edits: A Training-Free Diffusion-Based Video Editing with Image and Text Prompts14 Jun 2025
- 2025Many-for-Many: Unify the Training of Multiple Video and Image Generation and Manipulation Tasks2 Jun 2025
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing1 Jun 2025
- 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applications22 Apr 2025
- 2025Visual Prompting for One-shot Controllable Video Editing without Inversion19 Apr 2025
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Model11 Apr 2025
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar 2025
- 2025VACE: All-in-One Video Creation and Editing10 Mar 2025
- 2025Get In Video: Add Anything You Want to the Video8 Mar 2025
- 2025Learning to Animate Images from A Few Videos to Portray Delicate Human Actions1 Mar 2025
- 2025SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusion17 Feb 2025
- 2025Survey on Monocular Metric Depth Estimation21 Jan 2025
- 2024UFO: Enhancing Diffusion-Based Video Generation with a Uniform Frame Organizer12 Dec 2024
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation8 Dec 2024
- 2024DIVE: Taming DINO for Subject-Driven Video Editing4 Dec 2024
- 2024Beyond Generation: Unlocking Universal Editing via Self-Supervised Fine-Tuning3 Dec 2024
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Image26 Nov 2024
- 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editing22 Nov 2024
- 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models20 Nov 2024
- 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices15 Oct 2024
- 2024GenRec: Unifying Video Generation and Recognition with Diffusion Models27 Aug 2024
- 2024Still-Moving: Customized Video Generation without Customized Video Data11 Jul 2024
- 2024GVDIFF: Grounded Text-to-Video Generation with Diffusion Models2 Jul 2024
- 2024Diffusion Model-Based Video Editing: A Survey26 Jun 2024
- 2024MVOC: a training-free multiple video object composition method with diffusion models22 Jun 2024
- 2024Depth Anything V213 Jun 2024
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun 2024
- 2024Temporally Consistent Object Editing in Videos using Extended Attention1 Jun 2024
- 2024LLMs Meet Multimodal Generation and Editing: A Survey29 May 2024
- 2024Towards Multi-Task Multi-Modal Models: A Video Generative Perspective26 May 2024
- 2024PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Control23 May 2024
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator13 May 2024
- 2024BadPart: Unified Black-box Adversarial Patch Attacks against Pixel-wise Regression Tasks1 Apr 2024
50 newest of 75 All 75 (JSON)
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023A Survey on Video Diffusion Modelscited by 203
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 113
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 95
- 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 80
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
- 2024Diffusion Model-Based Video Editing: A Surveycited by 44
- 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 39
12 most cited of 38 All 38 (JSON)
- 2026AnyTalk: Speech Animation for Arbitrary Characters Leveraging a Video Generation Model17 Aug 2026
- 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editing10 Feb 2026
- 2026SnapGen++: Unleashing Diffusion Transformers for Efficient High-Fidelity Image Generation on Edge Devices13 Jan 2026
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation21 Oct 2025
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Models22 Sep 2025
- 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization20 Aug 2025
- 2025VideoGuard: Protecting Video Content from Unauthorized Editing5 Aug 2025
- 2025Good Noise Makes Good Edits: A Training-Free Diffusion-Based Video Editing with Image and Text Prompts14 Jun 2025
- 2025Many-for-Many: Unify the Training of Multiple Video and Image Generation and Manipulation Tasks2 Jun 2025
- 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applications22 Apr 2025
- 2025Visual Prompting for One-shot Controllable Video Editing without Inversion19 Apr 2025
- 2025VACE: All-in-One Video Creation and Editing10 Mar 2025
12 newest of 38 All 38 (JSON)
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 81
- 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2023LivePhoto: Real Image Animation with Text-guided Motion Controlcited by 44
12 most cited of 33 All 33 (JSON)
- 2026Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomy28 Sep 2026
- 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications28 Jul 2026
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
- 2026AVControl: Efficient Framework for Training Audio-Visual Controls25 Mar 2026
- 2026FlexAM: Flexible Appearance-Motion Decomposition for Versatile Video Generation Control13 Feb 2026
- 2025Generative Video Motion Editing with 3D Point Tracks1 Dec 2025
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videos9 Oct 2025
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution9 Oct 2025
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing1 Jun 2025
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Model11 Apr 2025
- 2025Get In Video: Add Anything You Want to the Video8 Mar 2025
- 2025Learning to Animate Images from A Few Videos to Portray Delicate Human Actions1 Mar 2025
12 newest of 33 All 33 (JSON)