OmniPSD: Layered PSD Generation with Diffusion Transformer
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent advances in diffusion models have greatly improved image generation and editing, yet generating or reconstructing layered PSD files with transparent alpha channels remains highly challenging. We propose OmniPSD, a unified diffusion framework built upon the Flux ecosystem that enables both text-to-PSD generation and image-to-PSD decomposition through in-context learning. For text-to-PSD generation, OmniPSD arranges multiple target layers spatially into a single canvas and learns their compositional relationships through spatial attention, producing semantically coherent and hierarchically structured layers. For image-to-PSD decomposition, it performs iterative in-context editing, progressively extracting and erasing textual and foreground components to reconstruct editable PSD layers from a single flattened image. An RGBA-VAE is employed as an auxiliary representation module to preserve transparency without affecting structure learning. Extensive experiments on our new RGBA-layered dataset demonstrate that OmniPSD achieves high-fidelity generation, structural consistency, and transparency awareness, offering a new paradigm for layered design generation and decomposition with diffusion transformers.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 64 of its 80 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
64 of 80 references.
Closest ancestors · 14
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformers3 Jun
- 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generation3 Feb
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer3 Feb
- 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors5 Dec
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation16 Nov
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding14 May
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Model18 Mar
- 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model12 Mar
- 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul
2 more
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Generative Adversarial Networkscited by 5,603
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
38 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022Video Diffusion Modelscited by 2,280
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2017Deep Image Mattingcited by 150
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2020Background Matting: The World is Your Green Screencited by 104
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 39
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2024Graphic Design with Large Multimodal Modelcited by 38
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 34
- 2024Generative Image Layer Decomposition with Visual Effectscited by 33
- 20241.58-bit FLUXcited by 31
- 2023Matting Anythingcited by 30
- 2020Multi-modal Attention for Speech Emotion Recognitioncited by 29
- 2025TransAnimate: Taming Layer Diffusion to Generate RGBA Videocited by 24
- 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
- 2020Learning to See Through Obstructions with Layered Decompositioncited by 20
- 2024Alfie: Democratising RGBA Image Generation With No cited by 20
- 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
- 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
- 2024Multimodal Markup Document Models for Graphic Design Completioncited by 15
- 2025LayeringDiff: Layered Image Synthesis via Generation, then Disassembly with Generative Knowledgecited by 15
- 2025Personalized Vision via Visual In-Context Learningcited by 14
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
- 2025PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignmentcited by 11
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 7
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motioncited by 7
- 2026LaDe: Unified Multi-Layered Graphic Media Generation and Decompositioncited by 5
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 3
- 2026SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokenscited by 2
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Productioncited by 1
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decompositioncited by 1
- 2026LimeCross: Context-Conditioned Layered Image Editing with Structural Consistencycited by 0
- 2026LiWi: Layering in the Wildcited by 0
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Designcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretrainingcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining19 Sep 2026
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Design4 Aug 2026
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition28 Jul 2026
- 2026PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion31 May 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026LiWi: Layering in the Wild14 May 2026
- 2026LimeCross: Context-Conditioned Layered Image Editing with Structural Consistency11 May 2026
- 2026LaDe: Unified Multi-Layered Graphic Media Generation and Decomposition18 Mar 2026
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Production16 Mar 2026
- 2026SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokens7 Feb 2026
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
- 2024Streamlining Image Editing with Layered Diffusion Brushes
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance
- 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models
- 2024Move Anything with Layered Scene Diffusion
- 2025MADI: Masking-Augmented Diffusion with Inference-Time Scaling for Visual Editing
- 2025OminiControl2: Efficient Conditioning for Diffusion Transformers
- 2026StructDiff: A Structure-Preserving and Spatially Controllable Diffusion Model for Single-Image Generation