mlsanityData to 7 Oct 2026

NOVA: Sparse Control, Dense Synthesis for Pair-Free Video Editing

arXiv 2603.02802 ↗First posted 3 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Recent video editing models have achieved impressive results, but most still require large-scale paired datasets. Collecting such naturally aligned pairs at scale remains highly challenging and constitutes a critical bottleneck, especially for local video editing data. Existing workarounds transfer image editing to video through global motion control for pair-free video editing, but such designs struggle with background and temporal consistency. In this paper, we propose NOVA: Sparse Control & Dense Synthesis, a new framework for unpaired video editing. Specifically, the sparse branch provides semantic guidance through user-edited keyframes distributed across the video, and the dense branch continuously incorporates motion and texture information from the original video to maintain high fidelity and coherence. Moreover, we introduce a degradation-simulation training strategy that enables the model to learn motion reconstruction and temporal consistency by training on artificially degraded videos, thus eliminating the need for paired data. Our extensive experiments demonstrate that NOVA outperforms existing approaches in edit fidelity, motion preservation, and temporal coherence.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 52 of its 57 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

52 of 57 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  11. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
38 more
  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  6. 2025Qwen-Image Technical Reportcited by 973
  7. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  8. 2025VACE: All-in-One Video Creation and Editingcited by 467
  9. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  10. 2023Pix2Video: Video Editing using Image Diffusioncited by 318
  11. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  12. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  13. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  14. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  15. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
  16. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
  17. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  18. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
  19. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 135
  20. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 111
  21. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
  22. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 80
  23. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  24. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  25. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  26. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
  27. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
  28. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
  29. 2023DragVideo: Interactive Drag-style Video Editingcited by 40
  30. 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesiscited by 39
  31. 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 39
  32. 2024Generative Video Propagationcited by 36
  33. 2025ROSE: Remove Objects with Side Effects in Videoscited by 32
  34. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 27
  35. 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
  36. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 24
  37. 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10
  38. 2025DreamVE: Unified Instruction-based Image and Video Editingcited by 9

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.