AbracADDbra: Touch-Guided Object Addition by Decoupling Placement and Editing Subtasks
Not on the map. Why?
Abstract (arXiv)
Instruction-based object addition is often hindered by the ambiguity of text-only prompts or the tedious nature of mask-based inputs. To address this usability gap, we introduce AbracADDbra, a user-friendly framework that leverages intuitive touch priors to spatially ground succinct instructions for precise placement. Our efficient, decoupled architecture uses a vision-language transformer for touch-guided placement, followed by a diffusion model that jointly generates the object and an instance mask for high-fidelity blending. To facilitate standardized evaluation, we contribute the Touch2Add benchmark for this interactive task. Our extensive evaluations, where our placement model significantly outperforms both random placement and general-purpose VLM baselines, confirm the framework's ability to produce high-fidelity edits. Furthermore, our analysis reveals a strong correlation between initial placement accuracy and final edit quality, validating our decoupled approach. This work thus paves the way for more accessible and efficient creative tools.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 22 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
21 of 22 references.
References · 21
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Visual Instruction Tuningcited by 7,792
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
- 2022Blended Latent Diffusioncited by 430
9 more
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 172
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
- 2023ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Promptscited by 160
- 2023Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMscited by 47
- 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them Firstcited by 39
- 2024EraseDraw: Learning to Draw Step-by-Step via Erasing Objects from Imagescited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Models
- 2026CoT-Edit: Let CoT Guide Instruction Video Editing
- 2026DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model
- 2025Controllable 3D Placement of Objects with Scene-Aware Diffusion Models
- 2024BrushEdit: All-In-One Image Inpainting and Editing
- 2025CompBench: Benchmarking Complex Instruction-guided Image Editing
- 2025InstructUDrag: Joint Text Instructions and Object Dragging for Interactive Image Editing
- 2026Instruction-based Image Editing with Planning, Reasoning, and Generation