mlsanityData to 14 Oct 2026

Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning

arXiv 2603.15003 ↗First posted 16 Mar 2026cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Pre-trained image editing models exhibit strong spatial reasoning and object-aware transformation capabilities acquired from billions of image-text pairs, yet they possess no explicit temporal modeling. This paper demonstrates that these spatial priors can be repurposed to unlock temporal synthesis capabilities through minimal adaptation - without introducing any video-specific architecture or motion estimation modules. We show that a large image editing model (Qwen-Image-Edit), originally designed solely for static instruction-based edits, can be adapted for Video Frame Interpolation (VFI) using only 64-256 training samples via Low-Rank Adaptation (LoRA). Our core contribution is revealing that the model's inherent understanding of "how objects transform" in static scenes contains latent temporal reasoning that can be activated through few-shot fine-tuning. While the baseline model completely fails at producing coherent intermediate frames, our parameter-efficient adaptation successfully unlocks its interpolation capability. Rather than competing with task-specific VFI methods trained from scratch on massive datasets, our work establishes that foundation image editing models possess untapped potential for temporal tasks, offering a data-efficient pathway for video synthesis in resource-constrained scenarios. This bridges the gap between image manipulation and video understanding, suggesting that spatial and temporal reasoning may be more intertwined in foundation models than previously recognized

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 32 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

26 of 32 references.

References · 26

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2025Qwen-Image Technical Reportcited by 1,044
  5. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  6. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  7. 2017Video Enhancement with Task-Oriented Flowcited by 619
  8. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  9. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
  10. 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
  11. 2024Video Interpolation with Diffusion Modelscited by 68
  12. 2022FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoationcited by 37
14 more
  1. 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
  2. 2024ViBiDSampler: Enhancing Video Interpolation Using Bidirectional Diffusion Samplercited by 21
  3. 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
  4. 2022Exploring Motion Ambiguity and Alignment for High-Quality Video Frame Interpolationcited by 17
  5. 2022Enhanced Bi-directional Motion Estimation for Video Frame Interpolationcited by 17
  6. 2024Sparse High Rank Adapterscited by 17
  7. 2024Generalizable Implicit Motion Modeling for Video Frame Interpolationcited by 16
  8. 2022TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolationcited by 14
  9. 2024OCAI: Improving Optical Flow Estimation by Occlusion and Consistency Aware Interpolationcited by 11
  10. 2022Enhancing Deformable Convolution based Video Frame Interpolation with Coarse-to-fine 3D CNNcited by 10
  11. 2025Hierarchical Flow Diffusion for Efficient Frame Interpolationcited by 7
  12. 2025Exploring Sparsity for Parameter Efficient Fine Tuning Using Wavelets for Visioncited by 7
  13. 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Modelscited by 4
  14. 2023Spatio-Temporal Perception-Distortion Trade-off in Learned Video SRcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
  2. 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
  3. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning
  4. 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
  5. 2026CoT-Edit: Let CoT Guide Instruction Video Editing
  6. 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation
  7. 2025Zero-Shot Video Translation and Editing with Frame Spatial-Temporal Correspondence
  8. 2024Temporally Consistent Object Editing in Videos using Extended Attention