mlsanityData to 14 Oct 2026

TokenFlow: Consistent Diffusion Features for Consistent Video Editing

arXiv 2307.10373 ↗First posted 19 Jul 2023cs.CVcited by 442

Not on the map. Why?

Cited by 218 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we present a framework that harnesses the power of a text-to-image diffusion model for the task of text-driven video editing. Specifically, given a source video and a target text-prompt, our method generates a high-quality video that adheres to the target text, while preserving the spatial layout and motion of the input video. Our method is based on a key observation that consistency in the edited video can be obtained by enforcing consistency in the diffusion feature space. We achieve this by explicitly propagating diffusion features based on inter-frame correspondences, readily available in the model. Thus, our framework does not require any training or fine-tuning, and can work in conjunction with any off-the-shelf text-to-image editing method. We demonstrate state-of-the-art editing results on a variety of real-world videos. Webpage: https://diffusion-tokenflow.github.io/

Key facts. Cited by 442 papers in the map (data through 14 Oct 2026). Builds on 53 of its 63 references that are in the map. First posted on arXiv 19 Jul 2023.

Builds on

53 of 63 references.

References · 53

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  12. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
38 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2022Video Diffusion Modelscited by 2,305
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  10. 2022Diffusion Models in Vision: A Surveycited by 1,015
  11. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  12. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  13. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  14. 2016Generative Adversarial Text to Image Synthesiscited by 735
  15. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  16. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  17. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  18. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  19. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  20. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  21. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  22. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  23. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  24. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  25. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
  26. 2018Learning Blind Video Temporal Consistencycited by 253
  27. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  28. 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
  29. 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 168
  30. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  31. 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 154
  32. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
  33. 2021Layered Neural Atlases for Consistent Video Editingcited by 137
  34. 2022KNN-Diffusion: Image Generation via Large-Scale Retrievalcited by 137
  35. 2020Blind Video Temporal Consistency via Deep Video Priorcited by 76
  36. 2023Directed Diffusion: Direct Control of Object Placement through Attention Guidancecited by 69
  37. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 67
  38. 2023Shape-aware Text-driven Layered Video Editingcited by 54

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 55; 2024: 131; 2025: 140; 2026: 116.

442 papers.

Sort:

By area:

  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  3. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  4. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  5. 2023A Survey on Video Diffusion Modelscited by 206
  6. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  7. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  8. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  9. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  10. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  11. 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 136
  12. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
38 more
  1. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
  2. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  3. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
  4. 2024Training-Free Consistent Text-to-Image Generationcited by 125
  5. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  6. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  7. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
  8. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  9. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
  10. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
  11. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  12. 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 86
  13. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
  14. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 86
  15. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 82
  16. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 82
  17. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  18. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  19. 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
  20. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  21. 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
  22. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
  23. 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
  24. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  25. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
  26. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 63
  27. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  28. 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
  29. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  30. 2024Video Diffusion Models are Training-free Motion Interpreter and Controllercited by 61
  31. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  32. 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Modelscited by 59
  33. 2023LAMP: Learn A Motion Pattern for Few-Shot-Based Video Generationcited by 59
  34. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
  35. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 58
  36. 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Modelscited by 56
  37. 2023CVPR 2023 Text Guided Video Editing Competitioncited by 55
  38. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55

50 most cited of 442 All 442 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editing
  2. 2023Dreamix: Video Diffusion Models are General Video Editors
  3. 2025TokensGen: Harnessing Condensed Tokens for Long Video Generation
  4. 2023Towards Consistent Video Editing with Text-to-Image Diffusion Models
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
  6. 2023Text-to-image Diffusion Models in Generative AI: A Survey
  7. 2023Edit Temporal-Consistent Videos with Image Diffusion Model
  8. 2023Highly Detailed and Temporal Consistent Video Stylization via Synchronized Multi-Frame Diffusion