mlsanityData to 7 Oct 2026

UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing

arXiv 2402.13185 ↗First posted 20 Feb 2024cs.CVcited by 47

Not on the map. Why?

Cited by 22 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advances in text-guided video editing have showcased promising results in appearance editing (e.g., stylization). However, video motion editing in the temporal dimension (e.g., from eating to waving), which distinguishes video editing from image editing, is underexplored. In this work, we present UniEdit, a tuning-free framework that supports both video motion and appearance editing by harnessing the power of a pre-trained text-to-video generator within an inversion-then-generation framework. To realize motion editing while preserving source video content, based on the insights that temporal and spatial self-attention layers encode inter-frame and intra-frame dependency respectively, we introduce auxiliary motion-reference and reconstruction branches to produce text-guided motion and source features respectively. The obtained features are then injected into the main editing path via temporal and spatial self-attention layers. Extensive experiments demonstrate that UniEdit covers video motion editing and various appearance editing scenarios, and surpasses the state-of-the-art methods. Our code will be publicly available.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 78 of its 91 references that are in the map. First posted on arXiv 20 Feb 2024.

Builds on

78 of 91 references.

References · 78

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2023Segment Anythingcited by 8,158
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
38 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  2. 2022Video Diffusion Modelscited by 2,280
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  10. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  11. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  12. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  13. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  14. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  15. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  16. 2023ModelScope Text-to-Video Technical Reportcited by 651
  17. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  18. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  19. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  20. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  21. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
  22. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  23. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  24. 2016Generating Videos with Scene Dynamicscited by 376
  25. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  26. 2022MAGVIT: Masked Generative Video Transformercited by 341
  27. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  28. 2023Pix2Video: Video Editing using Image Diffusioncited by 318
  29. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  30. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
  31. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  32. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  33. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  34. 2016Temporal Generative Adversarial Nets with Singular Value Clippingcited by 198
  35. 2019Few-shot Video-to-Video Synthesiscited by 196
  36. 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
  37. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
  38. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173

50 most cited of 78 All 78 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 22; 2025: 14; 2026: 11.

47 papers.

Sort:

By area:

  1. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
  2. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
  3. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 76
  4. 2024Diffusion Model-Based Video Editing: A Surveycited by 44
  5. 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 39
  6. 2024Video Motion Transfer with Diffusion Transformerscited by 39
  7. 2024VidTok: A Versatile and Open-Source Video Tokenizercited by 35
  8. 2024Video Diffusion Models: A Surveycited by 28
  9. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  10. 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
  11. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 24
  12. 2024Spectral Motion Alignment for Video Motion Transfer using Diffusion Modelscited by 20
35 more
  1. 2025Dynamic Concepts Personalization from Single Videoscited by 20
  2. 2024Compositional 3D-aware Video Generation with LLM Directorcited by 18
  3. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Modelscited by 16
  4. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  5. 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applicationscited by 14
  6. 2024Edit-Your-Motion: Space-Time Diffusion Decoupling Learning for Video Motion Editingcited by 10
  7. 2025SAIL-Embedding Technical Report: Omni-modal Embedding Foundation Modelcited by 10
  8. 2024LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-Text Generation?cited by 9
  9. 2025DualReal: Adaptive Joint Training for Lossless Identity-Motion Fusion in Video Customizationcited by 9
  10. 2025LayerFlow: A Unified Model for Layer-aware Video Generationcited by 9
  11. 2024Reenact Anything: Semantic Video Motion Transfer Using Motion-Textual Inversioncited by 6
  12. 2025DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Imagecited by 6
  13. 2026Evolution of Video Generative Foundationscited by 6
  14. 2024AudioScenic: Audio-Driven Video Scene Editingcited by 5
  15. 2024MatchDiffusion: Training-free Generation of Match-cutscited by 5
  16. 2024OmniDrag: Enabling Motion Control for Omnidirectional Image-to-Video Generationcited by 5
  17. 2025Super Encoding Network: Recursive Association of Multi-Modal Encoders for Video Understandingcited by 4
  18. 2024FreeMask: Rethinking the Importance of Attention Masks for Zero-Shot Video Editingcited by 3
  19. 2024Motion by Queries: Identity-Motion Trade-offs in Text-to-Video Generationcited by 3
  20. 2026TRACE: Object Motion Editing in Videos with First-Frame Trajectory Guidancecited by 3
  21. 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Frameworkcited by 3
  22. 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splattingcited by 2
  23. 2024Beyond Generation: Unlocking Universal Editing via Self-Supervised Fine-Tuningcited by 2
  24. 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generationcited by 2
  25. 2025RASA: Replace Anyone, Say Anything -- A Training-Free Framework for Audio-Driven and Universal Portrait Video Editingcited by 1
  26. 2025STR-Match: Matching SpatioTemporal Relevance Score for Training-Free Video Editingcited by 0
  27. 2025HairShifter: Consistent and High-Fidelity Video Hair Transfer via Anchor-Guided Animationcited by 0
  28. 2025Enhancing Video Inpainting with Aligned Frame Interval Guidancecited by 0
  29. 2026When Numbers Speak: Aligning Textual Numerals and Visual Instances in Text-to-Video Diffusion Modelscited by 0
  30. 2026OphEdit: Training-Free Text-Guided Editing of Ophthalmic Surgical Videoscited by 0
  31. 2026TeDiO: Temporal Diagonal Optimization for Training-Free Coherent Video Diffusioncited by 0
  32. 2026Sound Sparks Motion: Audio and Text Tuning for Video Editingcited by 0
  33. 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformerscited by 0
  34. 2026Streaming Video Editing with Easy Adaptationcited by 0
  35. 2026Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomycited by 0