mlsanityData to 14 Oct 2026

EasyV2V: A High-quality Instruction-based Video Editing Framework

arXiv 2512.16920 ↗First posted 18 Dec 2025cs.CV cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

While image editing has advanced rapidly, video editing remains less explored, facing challenges in consistency, control, and generalization. We study the design space of data, architecture, and control, and introduce EasyV2V, a simple and effective framework for instruction-based video editing. On the data side, we compose existing experts with fast inverses to build diverse video pairs, lift image edit pairs into videos via single-frame supervision and pseudo pairs with shared affine motion, mine dense-captioned clips for video pairs, and add transition supervision to teach how edits unfold. On the model side, we observe that pretrained text-to-video models possess editing capability, motivating a simplified design. Simple sequence concatenation for conditioning with light LoRA fine-tuning suffices to train a strong model. For control, we unify spatiotemporal control via a single mask mechanism and support optional reference images. Overall, EasyV2V works with flexible inputs, e.g., video+text, video+mask+text, video+mask+reference+text, and achieves state-of-the-art video editing results, surpassing concurrent and commercial systems. Project page: https://snap-research.github.io/easyv2v/

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 56 of its 67 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

56 of 67 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  11. 2025Gemma 3 Technical Reportcited by 1,824
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
38 more
  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  2. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  4. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  6. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  7. 2025VACE: All-in-One Video Creation and Editingcited by 479
  8. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  9. 2024OmniGen: Unified Image Generationcited by 394
  10. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  11. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  12. 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
  13. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  14. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  15. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  16. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  17. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  18. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  19. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
  20. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  21. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  22. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  23. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  24. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 137
  25. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  26. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  27. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  28. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  29. 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 70
  30. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  31. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  32. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
  33. 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
  34. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
  35. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
  36. 2024Video Editing via Factorized Diffusion Distillationcited by 41
  37. 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
  38. 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 40

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area: