mlsanityData to 14 Oct 2026

Trans-Adapter: A Plug-and-Play Framework for Transparent Image Inpainting

arXiv 2508.01098 ↗First posted 1 Aug 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

RGBA images, with the additional alpha channel, are crucial for any application that needs blending, masking, or transparency effects, making them more versatile than standard RGB images. Nevertheless, existing image inpainting methods are designed exclusively for RGB images. Conventional approaches to transparent image inpainting typically involve placing a background underneath RGBA images and employing a two-stage process: image inpainting followed by image matting. This pipeline, however, struggles to preserve transparency consistency in edited regions, and matting can introduce jagged edges along transparency boundaries. To address these challenges, we propose Trans-Adapter, a plug-and-play adapter that enables diffusion-based inpainting models to process transparent images directly. Trans-Adapter also supports controllable editing via ControlNet and can be seamlessly integrated into various community models. To evaluate our method, we introduce LayerBench, along with a novel non-reference alpha edge quality evaluation metric for assessing transparency edge quality. We conduct extensive experiments on LayerBench to demonstrate the effectiveness of our approach.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

45 of 55 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2023Segment Anythingcited by 8,234
  8. 2023Visual Instruction Tuningcited by 7,869
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2022Scalable Diffusion Models with Transformerscited by 6,054
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  12. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
33 more
  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  3. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  4. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  5. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  6. 2016Generative Adversarial Text to Image Synthesiscited by 735
  7. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  8. 2018Generative Image Inpainting with Contextual Attentioncited by 580
  9. 2022Blended Latent Diffusioncited by 432
  10. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
  11. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  12. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
  13. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  14. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  15. 2020Real-Time High-Resolution Background Mattingcited by 173
  16. 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
  17. 2017Deep Image Mattingcited by 150
  18. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
  19. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  20. 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Modelscited by 67
  21. 2021Semantic Image Mattingcited by 55
  22. 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
  23. 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
  24. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  25. 2023Matting Anythingcited by 31
  26. 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
  27. 20241.58-bit FLUXcited by 31
  28. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  29. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
  30. 2024Alfie: Democratising RGBA Image Generation With No cited by 20
  31. 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
  32. 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
  33. 2024Zippo: Zipping Color and Transparency Distributions into a Single Diffusion Modelcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.