mlsanityData to 14 Oct 2026

Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialists

arXiv 2502.06734 ↗First posted 10 Feb 2025cs.CVcited by 61

Not on the map. Why?

Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advancements in video generation have spurred the development of video editing techniques, which can be divided into inversion-based and end-to-end methods. However, current video editing methods still suffer from several challenges. Inversion-based methods, though training-free and flexible, are time-consuming during inference, struggle with fine-grained editing instructions, and produce artifacts and jitter. On the other hand, end-to-end methods, which rely on edited video pairs for training, offer faster inference speeds but often produce poor editing results due to a lack of high-quality training video pairs. In this paper, to close the gap in end-to-end methods, we introduce Se~norita-2M, a high-quality video editing dataset. Se~norita-2M consists of approximately 2 millions of video editing pairs. It is built by crafting four high-quality, specialized video editing models, each crafted and trained by our team to achieve state-of-the-art editing results. We also propose a filtering pipeline to eliminate poorly edited video pairs. Furthermore, we explore common video editing architectures to identify the most effective structure based on current pre-trained generative model. Extensive experiments show that our dataset can help to yield remarkably high-quality video editing results. More details are available at https://senorita-2m-dataset.github.io.

Key facts. Cited by 61 papers in the map (data through 14 Oct 2026). Builds on 61 of its 80 references that are in the map. First posted on arXiv 10 Feb 2025.

Builds on

61 of 80 references.

References · 61

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
38 more
  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  10. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  11. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  13. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  14. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  15. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  16. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  17. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  18. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  19. 2023Zero-shot Image-to-Image Translationcited by 505
  20. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  21. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  22. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  23. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
  24. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  25. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  26. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  27. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  28. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
  29. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 244
  30. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
  31. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  32. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  33. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  34. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
  35. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 175
  36. 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
  37. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  38. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 21; 2026: 40.

61 papers.

Sort:

By area:

  1. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  2. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  3. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  4. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
  5. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
  6. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
  7. 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 40
  8. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
  9. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
  10. 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 32
  11. 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimizationcited by 16
  12. 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
38 more
  1. 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
  2. 2026Bernini: Latent Semantic Planning for Video Diffusioncited by 12
  3. 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 11
  4. 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10
  5. 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 9
  6. 2025EgoEdit: Dataset, Real-Time Streaming Model, and Benchmark for Egocentric Video Editingcited by 8
  7. 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
  8. 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editingcited by 8
  9. 2026SpongeBob: Sync-Aware Harmonious Audio-Visual Generative Editingcited by 8
  10. 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learningcited by 7
  11. 2026Goku: A Million-Scale Universal Dataset and Benchmark for Instruction-Based Video Editingcited by 6
  12. 2025UniVid: Unifying Vision Tasks with Pre-trained Video Generation Modelscited by 5
  13. 2025LoVoRA: Text-guided and Mask-free Video Object Removal and Addition with Learnable Object-aware Localizationcited by 5
  14. 2026FFP-300K: Scaling First-Frame Propagation for Generalizable Video Editingcited by 5
  15. 2026TeleStyle: Content-Preserving Style Transfer in Images and Videoscited by 5
  16. 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editingcited by 5
  17. 2026NOVA: Sparse Control, Dense Synthesis for Pair-Free Video Editingcited by 4
  18. 2026LIVEditor-14B: Lightning Unified Video Editing via In-Context Sparse Attentioncited by 4
  19. 2026Tuning-free Visual Effect Transfer across Videoscited by 3
  20. 2026Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editingcited by 3
  21. 2026Omni-Fake: Benchmarking Unified Multimodal Social Media Deepfake Detectioncited by 3
  22. 2026ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationshipscited by 3
  23. 2026ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editingcited by 3
  24. 2026CoT-Edit: Let CoT Guide Instruction Video Editingcited by 3
  25. 2026Instruction-Based Video Editing by Repurposing an Image Editing Modelcited by 3
  26. 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generationcited by 2
  27. 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generationcited by 2
  28. 2026CoinVE-200K: A Large-Scale High-Quality Dataset for Compositional Instruction-Guided Video Editingcited by 2
  29. 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editingcited by 2
  30. 2025Refaccade: Editing Object with Given Reference Texturecited by 1
  31. 2026Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translationcited by 1
  32. 2026PLACID: Identity-Preserving Multi-Object Compositing via Video Diffusion with Synthetic Trajectoriescited by 1
  33. 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editingcited by 1
  34. 2026PropFly: Learning to Propagate via On-the-Fly Supervision from Pre-trained Video Diffusion Modelscited by 1
  35. 2026TokenDial: Continuous Attribute Control for Text-to-Video Generation in Visual Dial Spacecited by 1
  36. 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editingcited by 1
  37. 2026Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidancecited by 1
  38. 2026Go-with-the-Track: Video Compositing and Motion Control with Point Trackingcited by 1

50 most cited of 61 All 61 (JSON)