mlsanityData to 14 Oct 2026

Inpaint4Drag: Repurposing Inpainting Models for Drag-Based Image Editing via Bidirectional Warping

arXiv 2509.04582 ↗First posted 4 Sep 2025cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Drag-based image editing has emerged as a powerful paradigm for intuitive image manipulation. However, existing approaches predominantly rely on manipulating the latent space of generative models, leading to limited precision, delayed feedback, and model-specific constraints. Accordingly, we present Inpaint4Drag, a novel framework that decomposes drag-based editing into pixel-space bidirectional warping and image inpainting. Inspired by elastic object deformation in the physical world, we treat image regions as deformable materials that maintain natural shape under user manipulation. Our method achieves real-time warping previews (0.01s) and efficient inpainting (0.3s) at 512x512 resolution, significantly improving the interaction experience compared to existing methods that require minutes per edit. By transforming drag inputs directly into standard inpainting formats, our approach serves as a universal adapter for any inpainting model without architecture modification, automatically inheriting all future improvements in inpainting technology. Extensive experiments demonstrate that our method achieves superior visual quality and precise control while maintaining real-time performance. Project page: https://visual-ai.github.io/inpaint4drag/

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 4 Sep 2025.

Builds on

38 of 54 references.

References · 38

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023Segment Anythingcited by 8,234
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  9. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  10. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  11. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  12. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
26 more
  1. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  2. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  3. 2018Generative Image Inpainting with Contextual Attentioncited by 580
  4. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  5. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  6. 2023Emergent Correspondence from Image Diffusioncited by 446
  7. 2022Blended Latent Diffusioncited by 432
  8. 2021GAN Inversion: A Surveycited by 367
  9. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  10. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  11. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
  12. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
  13. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
  14. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  15. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  16. 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
  17. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
  18. 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
  19. 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editingcited by 88
  20. 2023The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editingcited by 62
  21. 2023Readout Guidance: Learning Control from Diffusion Featurescited by 52
  22. 2024RegionDrag: Fast Region-Based Image Editing with Diffusion Modelscited by 32
  23. 2024InstantDrag: Improving Interactivity in Drag-based Image Editingcited by 31
  24. 2022User-Controllable Latent Transformer for StyleGAN Image Layout Editingcited by 28
  25. 2024FastDrag: Manipulate Anything in One Stepcited by 21
  26. 2024RotationDrag: Point-based Image Editing with Rotated Diffusion Featurescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.