In-context Region-based Drag: Drag Any Region to Any Shape
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion models have shown promise in drag-style editing. Previous works mainly focus on point-based drag, which is inherently ambiguous. This paper focuses on region-based drag and introduces a novel In-Context Region-based Drag (ICRDrag) method. Under the in-context learning framework, ICRDrag consumes a source image, a source region mask, and a target region mask, producing the target dragged image. Built upon the basic in-context learning model, we introduce two novel attention regularization: 1) image-mask attention consistency to ensure that a target region attends to similar source regions for image and mask modalities; 2) source-target attention correspondence to ensure the mutual correspondence between source and target regions. To facilitate region-based drag, we also construct Paired Region Dataset (PRD), a large-scale dataset with paired masks and images. Extensive experiments show that ICRDrag significantly outperforms existing methods in both quantitative metrics and user studies, achieving superior editing accuracy and visual fidelity. The dataset, code, and model are available at https://github.com/bcmi/ICRDrag-Region-Drag-Editing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 69 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
61 of 69 references.
Closest ancestors · 20
Same direction, newest first
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editing2 Oct
- 2025LazyDrag: Enabling Stable Drag-Based Editing on Multi-Modal Diffusion Transformers via Explicit Correspondence15 Sep
- 2025AttentionDrag: Exploiting Latent Correlation Knowledge in Pre-trained Diffusion Models for Image Editing16 Jun
- 2025DragLoRA: Online Optimization of LoRA Adapters for Drag-based Image Editing in Diffusion Model18 May
- 2024In-Context LoRA for Diffusion Transformers31 Oct
- 2024AdaptiveDrag: Semantic-Driven Dragging on Diffusion-Based Image Editing16 Oct
- 2024RegionDrag: Fast Region-Based Image Editing with Diffusion Models25 Jul
- 2024DiffUHaul: A Training-Free Method for Object Dragging in Images3 Jun
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Models10 Apr
- 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing4 Feb
- 2023Readout Guidance: Learning Control from Diffusion Features4 Dec
- 2023The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editing2 Nov
8 more
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models5 Jul
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
- 2023In-Context Learning Unlocked for Diffusion Models1 May
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Fine-grained Image Editing by Pixel-wise Guidance Using Diffusion Models5 Dec
- 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Model15 Nov
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct
Other references · 41
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2019On The Power of Curriculum Learning in Training Deep Networkscited by 285
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
29 more
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
- 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
- 2023In-context Pretraining: Language Modeling Beyond Document Boundariescited by 76
- 2014Curriculum Learning of Multiple Taskscited by 65
- 2022Improving In-Context Few-Shot Learning via Self-Supervised Trainingcited by 56
- 2024Drag Your Noise: Interactive Point-based Editing via Diffusion Semantic Propagationcited by 50
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2023Pre-Training to Learn in Contextcited by 41
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objectscited by 32
- 2024InstantDrag: Improving Interactivity in Drag-based Image Editingcited by 30
- 2024DreamOmni: Unified Image Generation and Editingcited by 29
- 2024StableDrag: Stable Dragging for Point-based Image Editingcited by 28
- 2024FastDrag: Manipulate Anything in One Stepcited by 20
- 2024LightningDrag: Lightning Fast and Accurate Drag-based Image Editing Emerging from Videoscited by 18
- 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priorscited by 13
- 2024DragText: Rethinking Text Embedding in Point-based Image Editingcited by 12
- 2024CLIPDrag: Combining Text-based and Drag-based Instructions for Image Editingcited by 12
- 2025FlowDrag: 3D-aware Drag-based Image Editing with Mesh-guided Deformation Vector Flow Fieldscited by 8
- 2024Localize, Understand, Collaborate: Semantic-Aware Dragging via Intention Reasonercited by 7
- 2025Training-free Dense-Aligned Diffusion Guidance for Modular Conditional Image Synthesiscited by 6
- 2025Inpaint4Drag: Repurposing Inpainting Models for Drag-Based Image Editing via Bidirectional Warpingcited by 6
- 2024Edit One for All: Interactive Batch Image Editingcited by 5
- 2025DragNeXt: Rethinking Drag-Based Image Editingcited by 5
- 2025Dragging with Geometry: From Pixels to Geometry-Guided Image Editingcited by 4
- 2024Auto DragGAN: Editing the Generative Image Manifold in an Autoregressive Mannercited by 2
- 2025DirectDrag: High-Fidelity, Mask-Free, Prompt-Free Drag-based Image Editing via Readout-Guided Feature Alignmentcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Reproducing DragDiffusion: Interactive Point-Based Editing with Diffusion Models
- 2026Drag as Evidence: Motion-Grounded Latent Recomposition for Drag-Based Editing
- 2026RegionRoute: Regional Style Transfer with Diffusion Model
- 2024DragGaussian: Enabling Drag-style Manipulation on 3D Gaussian Representation
- 2023DragVideo: Interactive Drag-style Video Editing
- 2025InstructUDrag: Joint Text Instructions and Object Dragging for Interactive Image Editing
- 2024Temporally Consistent Object Editing in Videos using Extended Attention
- 2026Drag within Prior Distribution: Text-Conditioned Point-Based Image Editing within Distribution Constraints