InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Instruction-based video editing is a natural way to control video content with text, but adapting a video generation model into an editor usually appears data-hungry. At the same time, high-quality video editing data remains scarce. In this paper, we show that a video generation backbone can become a strong video editor without large scale video editing data. We present InsEdit, an instruction-based editing model built on HunyuanVideo-1.5. InsEdit combines a visual editing architecture with a video data pipeline based on Mutual Context Attention (MCA), which creates aligned video pairs where edits can begin in the middle of a clip rather than only from the first frame. With only O(100)K video editing data, InsEdit achieves state-of-the-art results among open-source methods on our video instruction editing benchmarks. In addition, because our training recipe also includes image editing data, the final model supports image editing without any modification.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 31 of its 40 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
31 of 40 references.
Closest ancestors · 7
Same direction, newest first
- 2025OmniV2V: Versatile Video Generation and Editing via Dynamic Content Manipulation2 Jun
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation18 Mar
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editing24 Feb
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models7 Dec
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing9 Oct
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
Other references · 24
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 64
12 more
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 32
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 23
- 2025UniVid: The Open-Source Unified Video Modelcited by 19
- 2025Training-free Geometric Image Editing on Diffusion Modelscited by 13
- 2025DreamVE: Unified Instruction-based Image and Video Editingcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Transforming Image Editors into Video Editorscited by 0
- 2026Transforming Image Editors into Video Editors8 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2026Instruction-Based Video Editing by Repurposing an Image Editing Model
- 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Models
- 2024InsightEdit: Towards Better Instruction Following for Image Editing
- 2023CCEdit: Creative and Controllable Video Editing via Diffusion Models
- 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimization
- 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learning
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models
- 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editing