Good Noise Makes Good Edits: A Training-Free Diffusion-Based Video Editing with Image and Text Prompts
On the map: Diffusion models → Video generation
Abstract (arXiv)
We propose VINO, the first zero-shot, training-free video editing method conditioned on both image and text. Our approach introduces ρ-start sampling and dilated dual masking to construct structured noise maps that enable coherent and accurate edits. To further enhance visual fidelity, we present zero image guidance, a controllable negative prompt strategy. Extensive experiments demonstrate that VINO faithfully incorporates the reference image into video edits, achieving strong performance compared to state-of-the-art baselines, all without any test-time or instance-specific training.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 49 of its 54 references that are in the map. First posted on arXiv 14 Jun 2025.
Builds on
49 of 54 references.
Closest ancestors · 18
Same direction, newest first
- 2024DeCo: Decoupled Human-Centered Diffusion Video Editing with Motion Consistency14 Aug
- 2024ReVideo: Remake a Video with Motion and Content Control22 May
- 2024TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models25 Apr
- 2024GenVideo: One-shot Target-image and Shape Aware Video Editing using T2I Diffusion Models18 Apr
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence4 Dec
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editing18 Aug
- 2023ModelScope Text-to-Video Technical Report12 Aug
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing14 Jun
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
- 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
6 more
- 2023Make-A-Protagonist: Generic Video Editing with An Ensemble of Experts15 May
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
- 2023Dreamix: Video Diffusion Models are General Video Editors2 Feb
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
Other references · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
19 more
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2022Blended Latent Diffusioncited by 432
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
- 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 76
- 2025Multi-subject Open-set Personalization in Video Generationcited by 66
- 2024Zero-shot Image Editing with Reference Imitationcited by 65
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2024STIV: Scalable Text and Image Conditioned Video Generationcited by 25
- 2023SAVE: Protagonist Diversification with Structure Agnostic Video Editingcited by 15
- 2023Cut-and-Paste: Subject-Driven Video Editing with Attention Controlcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models
- 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
- 2026FREE-Edit: Using Editing-aware Injection in Rectified Flow Models for Zero-shot Image-Driven Video Editing
- 2023EVE: Efficient zero-shot text-based Video Editing with Depth Map Guidance and Temporal Consistency Constraints
- 2026Diffusion Editing with Soft Mask: Pixel Level Redo of Image and Video with Adjustable Strength
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editing
- 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet