Are Image-to-Video Models Good Zero-Shot Image Editors?
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Large-scale video diffusion models show strong world simulation and temporal reasoning abilities, but their use as zero-shot image editors remains underexplored. We introduce IF-Edit, a tuning-free framework that repurposes pretrained image-to-video diffusion models for instruction-driven image editing. IF-Edit addresses three key challenges: prompt misalignment, redundant temporal latents, and blurry late-stage frames. It includes (1) a chain-of-thought prompt enhancement module that transforms static editing instructions into temporally grounded reasoning prompts; (2) a temporal latent dropout strategy that compresses frame latents after the expert-switch point, accelerating denoising while preserving semantic and temporal coherence; and (3) a self-consistent post-refinement step that sharpens late-stage frames using a short still-video trajectory. Experiments on four public benchmarks, covering non-rigid editing, physical and temporal reasoning, and general instruction edits, show that IF-Edit performs strongly on reasoning-centric tasks while remaining competitive on general-purpose edits. Our study provides a systematic view of video diffusion models as image editors and highlights a simple recipe for unified video-image generative reasoning.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 89 of its 112 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
89 of 112 references.
Closest ancestors · 2
Same direction, newest first
- 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation5 Oct
- 2025Video models are zero-shot learners and reasoners24 Sep
Other references · 87
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018World Modelscited by 1,513
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024OmniGen: Unified Image Generationcited by 394
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 148
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 132
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 94
50 most cited of 87 All 87 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Modelscited by 6
- 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editingcited by 3
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
- 2026Visual General Intelligence: A White Papercited by 1
- 2026Visual General Intelligence: A White Paper26 Aug 2026
- 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing25 Jun 2026
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking1 Apr 2026
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructions
- 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing
- 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models
- 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
- 2025Zero-Shot Video Translation and Editing with Frame Spatial-Temporal Correspondence
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidance