A2-Edit: Precise Reference-Guided Image Editing of Arbitrary Objects and Ambiguous Masks
Not on the map. Why?
Abstract (arXiv)
We propose A^2-Edit, a unified inpainting framework for arbitrary object categories, which allows users to replace any target region with a reference object using only a coarse mask. To address the issues of severe homogenization and limited category coverage in existing datasets, we construct a large-scale multi-category dataset, UniEdit-500K, which includes 8 major categories, 209 fine-grained subcategories, and a total of 500,104 image pairs. Such rich category diversity poses new challenges for the model, requiring it to automatically learn semantic relationships and distinctions across categories. To this end, we introduce the Mixture of Transformer module, which performs differentiated modeling of various object categories through dynamic expert selection, and further enhances cross-category semantic transfer and generalization through collaboration among experts. In addition, we propose a Mask Annealing Training Strategy (MATS) that progressively relaxes mask precision during training, reducing the model's reliance on accurate masks and improving robustness across diverse editing tasks. Extensive experiments on benchmarks such as VITON-HD and AnyInsertion demonstrate that A^2-Edit consistently outperforms existing approaches across all metrics, providing a new and efficient solution for arbitrary object editing.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 44 of its 53 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
44 of 53 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
32 more
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2025Qwen-Image Technical Reportcited by 973
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2019GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazingcited by 227
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 150
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 99
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2020CIAGAN: Conditional Identity Anonymization Generative Adversarial Networkscited by 88
- 2025DreamO: A Unified Framework for Image Customizationcited by 82
- 2024Zero-shot Image Editing with Reference Imitationcited by 64
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024VidGen-1M: A Large-Scale Dataset for Text-to-video Generationcited by 60
- 2023Putting People in Their Place: Affordance-Aware Human Insertion into Scenescited by 53
- 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
- 2024MoH: Multi-Head Attention as Mixture-of-Head Attentioncited by 41
- 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 35
- 2020Exploit Camera Raw Data for Video Super-Resolution via Hidden Markov Model Inferencecited by 18
- 2021Learning for Unconstrained Space-Time Video Super-Resolutioncited by 18
- 2023FastLLVE: Real-Time Low-Light Video Enhancement with Intensity-Aware Lookup Tablecited by 15
- 2021GridDehazeNet+: An Enhanced Multi-Scale Network with Intra-Task Knowledge Transfer for Single Image Dehazingcited by 14
- 2024Text2Place: Affordance-aware Text Guided Human Placementcited by 11
- 2025X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillationcited by 11
- 2025UMoE: Unifying Attention and FFN with Shared Expertscited by 6
- 2024AudioScenic: Audio-Driven Video Scene Editingcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.