mlsanityData to 14 Oct 2026

CCEdit: Creative and Controllable Video Editing via Diffusion Models

arXiv 2309.16496 ↗First posted 28 Sep 2023cs.CVcited by 82

On the map: Diffusion models → Video generation

Abstract (arXiv)

In this paper, we present CCEdit, a versatile generative video editing framework based on diffusion models. Our approach employs a novel trident network structure that separates structure and appearance control, ensuring precise and creative editing capabilities. Utilizing the foundational ControlNet architecture, we maintain the structural integrity of the video during editing. The incorporation of an additional appearance branch enables users to exert fine-grained control over the edited key frame. These two side branches seamlessly integrate into the main branch, which is constructed upon existing text-to-image (T2I) generation models, through learnable temporal layers. The versatility of our framework is demonstrated through a diverse range of choices in both structure representations and personalized T2I models, as well as the option to provide the edited key frame. To facilitate comprehensive evaluation, we introduce the BalanceCC benchmark dataset, comprising 100 videos and 4 target prompts for each video. Our extensive user studies compare CCEdit with eight state-of-the-art video editing methods. The outcomes demonstrate CCEdit's substantial superiority over all other methods.

Key facts. Cited by 82 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 53 of its 64 references that are in the map. First posted on arXiv 28 Sep 2023.

Builds on

53 of 64 references.

Closest ancestors · 15

Same direction, newest first

  1. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editing18 Aug
  2. 2023Edit Temporal-Consistent Videos with Image Diffusion Model17 Aug
  3. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  4. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
  5. 2023Towards Consistent Video Editing with Text-to-Image Diffusion Models27 May
  6. 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  8. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models30 Mar
  9. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  10. 2023Pix2Video: Video Editing using Image Diffusion22 Mar
  11. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
  12. 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
3 more
  1. 2023Dreamix: Video Diffusion Models are General Video Editors2 Feb
  2. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,288
26 more
  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  9. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  10. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  11. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  13. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  14. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  15. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  16. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  17. 2023Zero-shot Image-to-Image Translationcited by 505
  18. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  19. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  20. 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 246
  21. 2021Pixel Difference Networks for Efficient Edge Detectioncited by 168
  22. 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
  23. 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
  24. 2022Learning to generate line drawings that convey geometry and semanticscited by 83
  25. 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 76
  26. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 67

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 7; 2024: 23; 2025: 37; 2026: 15.

82 papers.

Sort:

By area:

  1. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  2. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  3. 2023A Survey on Video Diffusion Modelscited by 206
  4. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
  5. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  6. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
  7. 2024Training-free Camera Control for Video Generationcited by 122
  8. 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
  9. 2024FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translationcited by 49
  10. 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
  11. 2025Captain Cinema: Towards Short Movie Generationcited by 48
  12. 2025Parameter-Efficient Fine-Tuning for Foundation Modelscited by 45
38 more
  1. 2024Diffusion Model-Based Video Editing: A Surveycited by 44
  2. 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slicescited by 40
  3. 2024Generative Video Propagationcited by 36
  4. 2023ControlNet-XS: Rethinking the Control of Text-to-Image Diffusion Models as Feedback-Control Systemscited by 30
  5. 2024MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusioncited by 29
  6. 2025Generative Video Motion Editing with 3D Point Trackscited by 23
  7. 2025OmniVDiff: Omni Controllable Video Diffusion for Generation and Understandingcited by 22
  8. 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
  9. 2025Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Modelcited by 19
  10. 2025VideoAuteur: Towards Long Narrative Video Generationcited by 18
  11. 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
  12. 2024REDUCIO! Generating 1K Video within 16 Seconds using Extremely Compressed Motion Latentscited by 14
  13. 2025Unified Dense Prediction of Video Diffusioncited by 13
  14. 2025Get In Video: Add Anything You Want to the Videocited by 12
  15. 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessmentcited by 11
  16. 2024SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editingcited by 11
  17. 2025Controllable Weather Synthesis and Removal with Video Diffusion Modelscited by 11
  18. 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 11
  19. 2025TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfercited by 11
  20. 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generationcited by 11
  21. 2025VidSketch: Hand-drawn Sketch-Driven Video Generation with Diffusion Controlcited by 9
  22. 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
  23. 2025Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylizationcited by 8
  24. 2025Consistent Video Editing as Flow-Driven Image-to-Video Generationcited by 8
  25. 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformerscited by 8
  26. 2024NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editingcited by 7
  27. 2026Evolution of Video Generative Foundationscited by 7
  28. 2025DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Imagecited by 6
  29. 2025Causally Steered Diffusion for Automated Video Counterfactual Generationcited by 6
  30. 2025FreeViS: Training-free Video Stylization with Inconsistent Referencescited by 6
  31. 2024CoNo: Consistency Noise Injection for Tuning-free Long Video Diffusioncited by 5
  32. 2025iDiT-HOI: Inpainting-based Hand Object Interaction Reenactment via Video Diffusion Transformercited by 5
  33. 2025Point Prompting: Counterfactual Tracking with Video Diffusion Modelscited by 5
  34. 2023Fuse Your Latents: Video Editing with Multi-source Latent Diffusion Modelscited by 4
  35. 2026NOVA: Sparse Control, Dense Synthesis for Pair-Free Video Editingcited by 4
  36. 2024AnimateZoo: Zero-shot Video Generation of Cross-Species Animation via Subject Alignmentcited by 3
  37. 2024Text Prompting for Multi-Concept Video Customization by Autoregressive Generationcited by 3
  38. 2026Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editingcited by 3

50 most cited of 82 All 82 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models
  2. 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptation
  3. 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
  4. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models
  5. 2023VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing
  6. 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editing
  7. 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
  8. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generation