NOVA: Sparse Control, Dense Synthesis for Pair-Free Video Editing
Not on the map. Why?
Abstract (arXiv)
Recent video editing models have achieved impressive results, but most still require large-scale paired datasets. Collecting such naturally aligned pairs at scale remains highly challenging and constitutes a critical bottleneck, especially for local video editing data. Existing workarounds transfer image editing to video through global motion control for pair-free video editing, but such designs struggle with background and temporal consistency. In this paper, we propose NOVA: Sparse Control & Dense Synthesis, a new framework for unpaired video editing. Specifically, the sparse branch provides semantic guidance through user-edited keyframes distributed across the video, and the dense branch continuously incorporates motion and texture information from the original video to maintain high fidelity and coherence. Moreover, we introduce a degradation-simulation training strategy that enables the model to learn motion reconstruction and temporal consistency by training on artificially degraded videos, thus eliminating the need for paired data. Our extensive experiments demonstrate that NOVA outperforms existing approaches in edit fidelity, motion preservation, and temporal coherence.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 52 of its 57 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
52 of 57 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 135
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 111
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 80
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
- 2023DragVideo: Interactive Drag-style Video Editingcited by 40
- 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesiscited by 39
- 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 39
- 2024Generative Video Propagationcited by 36
- 2025ROSE: Remove Objects with Side Effects in Videoscited by 32
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 27
- 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
- 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 24
- 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10
- 2025DreamVE: Unified Instruction-based Image and Video Editingcited by 9
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.