Trans-Adapter: A Plug-and-Play Framework for Transparent Image Inpainting
Not on the map. Why?
Abstract (arXiv)
RGBA images, with the additional alpha channel, are crucial for any application that needs blending, masking, or transparency effects, making them more versatile than standard RGB images. Nevertheless, existing image inpainting methods are designed exclusively for RGB images. Conventional approaches to transparent image inpainting typically involve placing a background underneath RGBA images and employing a two-stage process: image inpainting followed by image matting. This pipeline, however, struggles to preserve transparency consistency in edited regions, and matting can introduce jagged edges along transparency boundaries. To address these challenges, we propose Trans-Adapter, a plug-and-play adapter that enables diffusion-based inpainting models to process transparent images directly. Trans-Adapter also supports controllable editing via ControlNet and can be seamlessly integrated into various community models. To evaluate our method, we introduce LayerBench, along with a novel non-reference alpha edge quality evaluation metric for assessing transparency edge quality. We conduct extensive experiments on LayerBench to demonstrate the effectiveness of our approach.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
45 of 55 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
33 more
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2022Blended Latent Diffusioncited by 432
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2020Real-Time High-Resolution Background Mattingcited by 173
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2017Deep Image Mattingcited by 150
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Modelscited by 67
- 2021Semantic Image Mattingcited by 55
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2023Matting Anythingcited by 31
- 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
- 20241.58-bit FLUXcited by 31
- 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
- 2024Alfie: Democratising RGBA Image Generation With No cited by 20
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
- 2024Zippo: Zipping Color and Transparency Distributions into a Single Diffusion Modelcited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 7
- 2026See-through: Single-image Layer Decomposition for Anime Characterscited by 3
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Modelcited by 2
- 2026LimeCross: Context-Conditioned Layered Image Editing with Structural Consistencycited by 0
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Mattingcited by 0
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting9 Aug 2026
- 2026LimeCross: Context-Conditioned Layered Image Editing with Structural Consistency11 May 2026
- 2026See-through: Single-image Layer Decomposition for Anime Characters3 Feb 2026
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Model4 Nov 2025
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner29 Sep 2025