mlsanityData to 7 Oct 2026

Video-P2P: Video Editing with Cross-attention Control

arXiv 2303.04761 ↗First posted 8 Mar 2023cs.CVcited by 312

Not on the map. Why?

Cited by 155 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This paper presents Video-P2P, a novel framework for real-world video editing with cross-attention control. While attention control has proven effective for image editing with pre-trained image generation models, there are currently no large-scale video generation models publicly available. Video-P2P addresses this limitation by adapting an image generation diffusion model to complete various video editing tasks. Specifically, we propose to first tune a Text-to-Set (T2S) model to complete an approximate inversion and then optimize a shared unconditional embedding to achieve accurate video inversion with a small memory cost. For attention control, we introduce a novel decoupled-guidance strategy, which uses different guidance strategies for the source and target prompts. The optimized unconditional embedding for the source prompt improves reconstruction ability, while an initialized unconditional embedding for the target prompt enhances editability. Incorporating the attention maps of these two branches enables detailed editing. These technical designs enable various text-driven editing applications, including word swap, prompt refinement, and attention re-weighting. Video-P2P works well on real-world videos for generating new characters while optimally preserving their original poses and scenes. It significantly outperforms previous approaches.

Key facts. Cited by 312 papers in the map (data through 7 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 8 Mar 2023.

Builds on

43 of 56 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2017Neural Discrete Representation Learningcited by 4,650
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
31 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  4. 2022Video Diffusion Modelscited by 2,280
  5. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  6. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  8. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  9. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  10. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  11. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  12. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  13. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  14. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  15. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  16. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  17. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  18. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  19. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  20. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  21. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  22. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  23. 2022Blended Latent Diffusioncited by 430
  24. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  25. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
  26. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
  27. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
  28. 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
  29. 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
  30. 2022SinFusion: Training Diffusion Models on a Single Image or Videocited by 58
  31. 2020Hierarchical Patch VAE-GAN: Generating Diverse Videos from a Single Samplecited by 43

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 70; 2024: 79; 2025: 112; 2026: 51.

312 papers.

Sort:

By area:

  1. 2025VACE: All-in-One Video Creation and Editingcited by 467
  2. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  3. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  4. 2023Pix2Video: Video Editing using Image Diffusioncited by 318
  5. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  6. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  7. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  8. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  9. 2023A Survey on Video Diffusion Modelscited by 203
  10. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  11. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  12. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
38 more
  1. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  2. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  3. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
  4. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
  5. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  6. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  7. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 135
  8. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
  9. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  10. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  11. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  12. 2024Training-free Camera Control for Video Generationcited by 119
  13. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 113
  14. 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
  15. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
  16. 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
  17. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  18. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 85
  19. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
  20. 2023VideoControlNet: A Motion-Guided Video-to-Video Translation Framework by Using Diffusion Model with ControlNetcited by 83
  21. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 80
  22. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 79
  23. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
  24. 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 75
  25. 2023Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animatorcited by 74
  26. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 73
  27. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  28. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 65
  29. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
  30. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
  31. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  32. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  33. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
  34. 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Modelscited by 58
  35. 2024Unveiling and Mitigating Memorization in Text-to-image Diffusion Models through Cross Attentioncited by 57
  36. 2023MotionEditor: Editing Video Motion via Content-Aware Diffusioncited by 56
  37. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
  38. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55

50 most cited of 312 All 312 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing
  2. 2024Shaping a Stabilized Video by Mitigating Unintended Changes for Concept-Augmented Video Editing
  3. 2024Temporally Consistent Object Editing in Videos using Extended Attention
  4. 2025Prompt-to-Prompt: Text-Based Image Editing Via Cross-Attention Mechanisms -- The Research of Hyperparameters and Novel Mechanisms to Enhance Existing Frameworks
  5. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing
  6. 2024Re-Attentional Controllable Video Diffusion Editing
  7. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing
  8. 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors