mlsanityData to 14 Oct 2026

Are Image-to-Video Models Good Zero-Shot Image Editors?

arXiv 2511.19435 ↗First posted 24 Nov 2025cs.CVcited by 4

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Large-scale video diffusion models show strong world simulation and temporal reasoning abilities, but their use as zero-shot image editors remains underexplored. We introduce IF-Edit, a tuning-free framework that repurposes pretrained image-to-video diffusion models for instruction-driven image editing. IF-Edit addresses three key challenges: prompt misalignment, redundant temporal latents, and blurry late-stage frames. It includes (1) a chain-of-thought prompt enhancement module that transforms static editing instructions into temporally grounded reasoning prompts; (2) a temporal latent dropout strategy that compresses frame latents after the expert-switch point, accelerating denoising while preserving semantic and temporal coherence; and (3) a self-consistent post-refinement step that sharpens late-stage frames using a short still-video trajectory. Experiments on four public benchmarks, covering non-rigid editing, physical and temporal reasoning, and general instruction edits, show that IF-Edit performs strongly on reasoning-centric tasks while remaining competitive on general-purpose edits. Our study provides a systematic view of video diffusion models as image editors and highlights a simple recipe for unified video-image generative reasoning.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 89 of its 112 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

89 of 112 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation5 Oct
  2. 2025Video models are zero-shot learners and reasoners24 Sep

Other references · 87

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2018World Modelscited by 1,513
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  4. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  5. 2025Qwen-Image Technical Reportcited by 1,044
  6. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  10. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  11. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  12. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  13. 2023Zero-shot Image-to-Image Translationcited by 505
  14. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  15. 2024OmniGen: Unified Image Generationcited by 394
  16. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  17. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  18. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  19. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  20. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  21. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  22. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  23. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  24. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  25. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  26. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  27. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  28. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
  29. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  30. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
  31. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 148
  32. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  33. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 132
  34. 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
  35. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
  36. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
  37. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
  38. 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 94

50 most cited of 87 All 87 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning
  2. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
  3. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructions
  4. 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing
  5. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models
  6. 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
  7. 2025Zero-Shot Video Translation and Editing with Frame Spatial-Temporal Correspondence
  8. 2025InstructX: Towards Unified Visual Editing with MLLM Guidance