mlsanityData to 14 Oct 2026

OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editing

arXiv 2512.07826 ↗First posted 8 Dec 2025cs.CVcited by 53

Not on the map. Why?

Abstract (arXiv)

The quality and diversity of instruction-based image editing datasets are continuously increasing, yet large-scale, high-quality datasets for instruction-based video editing remain scarce. To address this gap, we introduce OpenVE-3M, an open-source, large-scale, and high-quality dataset for instruction-based video editing. It comprises two primary categories: spatially-aligned edits (Global Style, Background Change, Local Change, Local Remove, Local Add, and Subtitles Edit) and non-spatially-aligned edits (Camera Multi-Shot Edit and Creative Edit). All edit types are generated via a meticulously designed data pipeline with rigorous quality filtering. OpenVE-3M surpasses existing open-source datasets in terms of scale, diversity of edit types, instruction length, and overall quality. Furthermore, to address the lack of a unified benchmark in the field, we construct OpenVE-Bench, containing 431 video-edit pairs that cover a diverse range of editing tasks with three key metrics highly aligned with human judgment. We present OpenVE-Edit, a 5B model trained on our dataset that demonstrates remarkable efficiency and effectiveness by setting a new state-of-the-art on OpenVE-Bench, outperforming all prior open-source models including a 14B baseline. Project page is at https://lewandofskee.github.io/projects/OpenVE.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

51 of 58 references.

References · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  12. 2025Qwen-Image Technical Reportcited by 1,044
38 more
  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  2. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  3. 2025VACE: All-in-One Video Creation and Editingcited by 479
  4. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  5. 2025Seed1.5-VL Technical Reportcited by 373
  6. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  7. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  8. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  9. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  10. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  11. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  12. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  13. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  14. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  15. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  16. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 114
  17. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  18. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 97
  19. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  20. 2025Describe Anything: Detailed Localized Image and Video Captioningcited by 84
  21. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  22. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  23. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 76
  24. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
  25. 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 70
  26. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  27. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  28. 2025UltraVideo: High-Quality UHD Video Dataset with Comprehensive Captionscited by 57
  29. 2025UNIC: Unified In-Context Video Editingcited by 55
  30. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
  31. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
  32. 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 40
  33. 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
  34. 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 32
  35. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
  36. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 25
  37. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 25
  38. 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Modelscited by 21

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 52.

53 papers.

Sort:

By area:

  1. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
  2. 2026OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoningcited by 27
  3. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  4. 2026Bernini: Latent Semantic Planning for Video Diffusioncited by 12
  5. 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 11
  6. 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 10
  7. 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 9
  8. 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editingcited by 8
  9. 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editingcited by 8
  10. 2026SpongeBob: Sync-Aware Harmonious Audio-Visual Generative Editingcited by 8
  11. 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editingcited by 6
  12. 2026Goku: A Million-Scale Universal Dataset and Benchmark for Instruction-Based Video Editingcited by 6
38 more
  1. 2026JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusioncited by 6
  2. 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editingcited by 5
  3. 2026Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generationcited by 5
  4. 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
  5. 2026Mamoda2.5: Enhancing Unified Multimodal Model with DiT-MoEcited by 3
  6. 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Frameworkcited by 3
  7. 2026ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationshipscited by 3
  8. 2026ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editingcited by 3
  9. 2026How Far Are Video Models from True Multimodal Reasoning?cited by 2
  10. 2026JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curationcited by 2
  11. 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generationcited by 2
  12. 2026GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networkscited by 2
  13. 2026CoinVE-200K: A Large-Scale High-Quality Dataset for Compositional Instruction-Guided Video Editingcited by 2
  14. 2025JoVA: Unified Multimodal Learning for Joint Video-Audio Generation and Editingcited by 1
  15. 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptationcited by 1
  16. 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editingcited by 1
  17. 2026Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidancecited by 1
  18. 2026MiVE: Multiscale Vision-language features for reference-guided video Editingcited by 1
  19. 2026DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preservercited by 1
  20. 2026OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editingcited by 1
  21. 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
  22. 2026Vibe AIGC: A New Paradigm for Content Generation via Agentic Orchestrationcited by 0
  23. 2026ImVideoEdit: Image-learning Video Editing via 2D Spatial Difference Attention Blockscited by 0
  24. 2026CogOmniControl: Reasoning-Driven Controllable Video Generation via Creative Intent Cognitioncited by 0
  25. 2026Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editingcited by 0
  26. 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editingcited by 0
  27. 2026Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPUcited by 0
  28. 2026From Dense Prediction to Visual Editing: Structured Supervision for Unified Image and Video Creationcited by 0
  29. 2026VicEdit: Learning to Edit Videos from Visual In-Context Examplescited by 0
  30. 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adaptercited by 0
  31. 2026Beyond Attention Masks: Instruction Anchoring for Efficient In-Context Diffusion Generationcited by 0
  32. 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editingcited by 0
  33. 2026EditaLive! Unified Character Video Editing for Live Streamingcited by 0
  34. 2026VideoX-Qwen: Data-Centric Instruction-Based Video Editingcited by 0
  35. 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videoscited by 0
  36. 2026AVIO: Learning to Add and Remove Sounding Objects in Audiovisual Scenescited by 0
  37. 2026ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editingcited by 0
  38. 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editingcited by 0

50 most cited of 53 All 53 (JSON)