mlsanityData to 7 Oct 2026

PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment

arXiv 2505.11468 ↗First posted 16 May 2025cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Transparent image layer generation plays a significant role in digital art and design workflows. Existing methods typically decompose transparent layers from a single RGB image using a set of tools or generate multiple transparent layers sequentially. Despite some promising results, these methods often limit their ability to model global layout, physically plausible interactions, and visual effects such as shadows and reflections with high alpha quality due to limited shared global context among layers. To address this issue, we propose PSDiffusion, a unified diffusion framework that leverages image composition priors from pre-trained image diffusion model for simultaneous multi-layer text-to-image generation. Specifically, our method introduces a global layer interaction mechanism to generate layered images collaboratively, ensuring both individual layer quality and coherent spatial and visual relationships across layers. We include extensive experiments on benchmark datasets to demonstrate that PSDiffusion is able to outperform existing methods in generating multi-layer images with plausible structure and enhanced visual fidelity.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 39 of its 45 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

39 of 45 references.

References · 39

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Segment Anythingcited by 8,158
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2025Qwen2.5-VL Technical Reportcited by 5,418
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
27 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  2. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  3. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  6. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  7. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  8. 2023Emergent Correspondence from Image Diffusioncited by 437
  9. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  10. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  11. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  12. 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
  13. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  14. 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
  15. 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
  16. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  17. 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 35
  18. 2024Generative Image Layer Decomposition with Visual Effectscited by 33
  19. 2023Matting Anythingcited by 30
  20. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
  21. 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
  22. 2024Alfie: Democratising RGBA Image Generation With No cited by 20
  23. 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priorscited by 19
  24. 2024Open-World Amodal Appearance Completioncited by 18
  25. 2025LayeringDiff: Layered Image Synthesis via Generation, then Disassembly with Generative Knowledgecited by 15
  26. 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
  27. 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generationcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 5.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation
  2. 2023Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis
  3. 2024Move Anything with Layered Scene Diffusion
  4. 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Mode
  5. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation
  6. 2026RefAny3D: 3D Asset-Referenced Diffusion Models for Image Generation
  7. 2023Text-Guided Texturing by Synchronized Multi-View Diffusion
  8. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation