Inpaint4Drag: Repurposing Inpainting Models for Drag-Based Image Editing via Bidirectional Warping
Not on the map. Why?
Abstract (arXiv)
Drag-based image editing has emerged as a powerful paradigm for intuitive image manipulation. However, existing approaches predominantly rely on manipulating the latent space of generative models, leading to limited precision, delayed feedback, and model-specific constraints. Accordingly, we present Inpaint4Drag, a novel framework that decomposes drag-based editing into pixel-space bidirectional warping and image inpainting. Inspired by elastic object deformation in the physical world, we treat image regions as deformable materials that maintain natural shape under user manipulation. Our method achieves real-time warping previews (0.01s) and efficient inpainting (0.3s) at 512x512 resolution, significantly improving the interaction experience compared to existing methods that require minutes per edit. By transforming drag inputs directly into standard inpainting formats, our approach serves as a universal adapter for any inpainting model without architecture modification, automatically inheriting all future improvements in inpainting technology. Extensive experiments demonstrate that our method achieves superior visual quality and precise control while maintaining real-time performance. Project page: https://visual-ai.github.io/inpaint4drag/
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 4 Sep 2025.
Builds on
38 of 54 references.
References · 38
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
26 more
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2022Blended Latent Diffusioncited by 432
- 2021GAN Inversion: A Surveycited by 367
- 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
- 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
- 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editingcited by 88
- 2023The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editingcited by 62
- 2023Readout Guidance: Learning Control from Diffusion Featurescited by 52
- 2024RegionDrag: Fast Region-Based Image Editing with Diffusion Modelscited by 32
- 2024InstantDrag: Improving Interactivity in Drag-based Image Editingcited by 31
- 2022User-Controllable Latent Transformer for StyleGAN Image Layout Editingcited by 28
- 2024FastDrag: Manipulate Anything in One Stepcited by 21
- 2024RotationDrag: Point-based Image Editing with Rotated Diffusion Featurescited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
- 2025LazyDrag: Enabling Stable Drag-Based Editing on Multi-Modal Diffusion Transformers via Explicit Correspondencecited by 4
- 2025ContextDrag: Precise Drag-Based Image Editing via Context-Preserving Token Injection and Position-Aligned Attentioncited by 1
- 2026In-context Region-based Drag: Drag Any Region to Any Shapecited by 0
- 2026RoPEMover: Depth-Aware Object Relocation via Positional Embeddingscited by 0
- 2026Drag as Evidence: Motion-Grounded Latent Recomposition for Drag-Based Editingcited by 0
- 2026ThinkDrag: Semantic Drag-Based Image Editing with Visual Reasoningcited by 0
- 2026ThinkDrag: Semantic Drag-Based Image Editing with Visual Reasoning9 Oct 2026
- 2026Drag as Evidence: Motion-Grounded Latent Recomposition for Drag-Based Editing29 Sep 2026
- 2026RoPEMover: Depth-Aware Object Relocation via Positional Embeddings25 Jun 2026
- 2026In-context Region-based Drag: Drag Any Region to Any Shape24 Jun 2026
- 2025ContextDrag: Precise Drag-Based Image Editing via Context-Preserving Token Injection and Position-Aligned Attention9 Dec 2025
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editing2 Oct 2025
- 2025LazyDrag: Enabling Stable Drag-Based Editing on Multi-Modal Diffusion Transformers via Explicit Correspondence15 Sep 2025