PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment
Not on the map. Why?
Abstract (arXiv)
Transparent image layer generation plays a significant role in digital art and design workflows. Existing methods typically decompose transparent layers from a single RGB image using a set of tools or generate multiple transparent layers sequentially. Despite some promising results, these methods often limit their ability to model global layout, physically plausible interactions, and visual effects such as shadows and reflections with high alpha quality due to limited shared global context among layers. To address this issue, we propose PSDiffusion, a unified diffusion framework that leverages image composition priors from pre-trained image diffusion model for simultaneous multi-layer text-to-image generation. Specifically, our method introduces a global layer interaction mechanism to generate layered images collaboratively, ensuring both individual layer quality and coherent spatial and visual relationships across layers. We include extensive experiments on benchmark datasets to demonstrate that PSDiffusion is able to outperform existing methods in generating multi-layer images with plausible structure and enhanced visual fidelity.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 39 of its 45 references that are in the map. First posted on arXiv 16 May 2025.
Builds on
39 of 45 references.
References · 39
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
27 more
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 35
- 2024Generative Image Layer Decomposition with Visual Effectscited by 33
- 2023Matting Anythingcited by 30
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
- 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
- 2024Alfie: Democratising RGBA Image Generation With No cited by 20
- 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priorscited by 19
- 2024Open-World Amodal Appearance Completioncited by 18
- 2025LayeringDiff: Layered Image Synthesis via Generation, then Disassembly with Generative Knowledgecited by 15
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generationcited by 13
Built on by
Citing papers per year: 2025: 6; 2026: 5.
11 papers.
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 11
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 6
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cuescited by 4
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Modelcited by 2
- 2026Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learningcited by 1
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effectscited by 0
- 2026TransText: Alpha-as-RGB Representation for Transparent Text Animationcited by 0
- 2026LimeCross: Context-Conditioned Layered Image Editing with Structural Consistencycited by 0
- 2026LiWi: Layering in the Wildcited by 0
- 2026Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learning28 May 2026
- 2026LiWi: Layering in the Wild14 May 2026
- 2026LimeCross: Context-Conditioned Layered Image Editing with Structural Consistency11 May 2026
- 2026TransText: Alpha-as-RGB Representation for Transparent Text Animation18 Mar 2026
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effects21 Jan 2026
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decomposition17 Dec 2025
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformer10 Dec 2025
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues2 Dec 2025
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Model4 Nov 2025
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner29 Sep 2025
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains24 May 2025
Similar, not cited
Close in wording, no citation either way
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation
- 2023Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis
- 2024Move Anything with Layered Scene Diffusion
- 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Mode
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation
- 2026RefAny3D: 3D Asset-Referenced Diffusion Models for Image Generation
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusion
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation