EasyV2V: A High-quality Instruction-based Video Editing Framework
Not on the map. Why?
Abstract (arXiv)
While image editing has advanced rapidly, video editing remains less explored, facing challenges in consistency, control, and generalization. We study the design space of data, architecture, and control, and introduce EasyV2V, a simple and effective framework for instruction-based video editing. On the data side, we compose existing experts with fast inverses to build diverse video pairs, lift image edit pairs into videos via single-frame supervision and pseudo pairs with shared affine motion, mine dense-captioned clips for video pairs, and add transition supervision to teach how edits unfold. On the model side, we observe that pretrained text-to-video models possess editing capability, motivating a simplified design. Simple sequence concatenation for conditioning with light LoRA fine-tuning suffices to train a strong model. For control, we unify spatiotemporal control via a single mask mechanism and support optional reference images. Overall, EasyV2V works with flexible inputs, e.g., video+text, video+mask+text, video+mask+reference+text, and achieves state-of-the-art video editing results, surpassing concurrent and commercial systems. Project page: https://snap-research.github.io/easyv2v/
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 56 of its 67 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
56 of 67 references.
References · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
38 more
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2024OmniGen: Unified Image Generationcited by 394
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 137
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 70
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
- 2024Video Editing via Factorized Diffusion Distillationcited by 41
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 40
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translationcited by 3
- 2026How to Correctly Make Mistakes: A Framework for Constructing and Benchmarking Mistake Aware Egocentric Procedural Videoscited by 2
- 2026GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networkscited by 2
- 2026DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preservercited by 1
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Trackingcited by 1
- 2026EgoPlay: Event-Triggered Video Editing for Egocentric Streamscited by 1
- 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Controlcited by 0
- 2026VicEdit: Learning to Edit Videos from Visual In-Context Examplescited by 0
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editingcited by 0
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editingcited by 0
- 2026Reimagine Video Dynamicscited by 0
- 2026A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videoscited by 0
- 2026AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation9 Oct 2026
- 2026A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videos5 Oct 2026
- 2026Reimagine Video Dynamics29 Sep 2026
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing18 Sep 2026
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing26 Aug 2026
- 2026VicEdit: Learning to Edit Videos from Visual In-Context Examples17 Aug 2026
- 2026GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networks17 Aug 2026
- 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control31 Jul 2026
- 2026EgoPlay: Event-Triggered Video Editing for Egocentric Streams27 Jul 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation7 Jul 2026
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Tracking18 Jun 2026
- 2026DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver28 May 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translationcited by 3
- 2026How to Correctly Make Mistakes: A Framework for Constructing and Benchmarking Mistake Aware Egocentric Procedural Videoscited by 2
- 2026GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networkscited by 2
- 2026DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preservercited by 1
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Trackingcited by 1
- 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Controlcited by 0
- 2026VicEdit: Learning to Edit Videos from Visual In-Context Examplescited by 0
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editingcited by 0
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editingcited by 0
- 2026Reimagine Video Dynamicscited by 0
- 2026A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videoscited by 0
- 2026A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videos5 Oct 2026
- 2026Reimagine Video Dynamics29 Sep 2026
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing18 Sep 2026
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing26 Aug 2026
- 2026VicEdit: Learning to Edit Videos from Visual In-Context Examples17 Aug 2026
- 2026GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networks17 Aug 2026
- 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control31 Jul 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation7 Jul 2026
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Tracking18 Jun 2026
- 2026DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver28 May 2026
- 2026How to Correctly Make Mistakes: A Framework for Constructing and Benchmarking Mistake Aware Egocentric Procedural Videos16 Apr 2026