mlsanityData to 7 Oct 2026

OmniPSD: Layered PSD Generation with Diffusion Transformer

arXiv 2512.09247 ↗First posted 10 Dec 2025cs.CVcited by 11

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent advances in diffusion models have greatly improved image generation and editing, yet generating or reconstructing layered PSD files with transparent alpha channels remains highly challenging. We propose OmniPSD, a unified diffusion framework built upon the Flux ecosystem that enables both text-to-PSD generation and image-to-PSD decomposition through in-context learning. For text-to-PSD generation, OmniPSD arranges multiple target layers spatially into a single canvas and learns their compositional relationships through spatial attention, producing semantically coherent and hierarchically structured layers. For image-to-PSD decomposition, it performs iterative in-context editing, progressively extracting and erasing textual and foreground components to reconstruct editable PSD layers from a single flattened image. An RGBA-VAE is employed as an auxiliary representation module to preserve transparency without affecting structure learning. Extensive experiments on our new RGBA-layered dataset demonstrate that OmniPSD achieves high-fidelity generation, structural consistency, and transparency awareness, offering a new paradigm for layered design generation and decomposition with diffusion transformers.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 64 of its 80 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

64 of 80 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  2. 2025RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformers3 Jun
  3. 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generation3 Feb
  4. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer3 Feb
  5. 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors5 Dec
  6. 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation16 Nov
  7. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding14 May
  8. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Model18 Mar
  9. 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model12 Mar
  10. 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  12. 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul
2 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  2. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  11. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  12. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
38 more
  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  3. 2022Video Diffusion Modelscited by 2,280
  4. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  5. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  6. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  7. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  8. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  9. 2017Deep Image Mattingcited by 150
  10. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
  11. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  12. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  13. 2020Background Matting: The World is Your Green Screencited by 104
  14. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  15. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  16. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 39
  17. 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
  18. 2024Graphic Design with Large Multimodal Modelcited by 38
  19. 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
  20. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  21. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
  22. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 34
  23. 2024Generative Image Layer Decomposition with Visual Effectscited by 33
  24. 20241.58-bit FLUXcited by 31
  25. 2023Matting Anythingcited by 30
  26. 2020Multi-modal Attention for Speech Emotion Recognitioncited by 29
  27. 2025TransAnimate: Taming Layer Diffusion to Generate RGBA Videocited by 24
  28. 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
  29. 2020Learning to See Through Obstructions with Layered Decompositioncited by 20
  30. 2024Alfie: Democratising RGBA Image Generation With No cited by 20
  31. 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
  32. 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
  33. 2024Multimodal Markup Document Models for Graphic Design Completioncited by 15
  34. 2025LayeringDiff: Layered Image Synthesis via Generation, then Disassembly with Generative Knowledgecited by 15
  35. 2025Personalized Vision via Visual In-Context Learningcited by 14
  36. 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
  37. 2025PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignmentcited by 11
  38. 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
  2. 2024Streamlining Image Editing with Layered Diffusion Brushes
  3. 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance
  4. 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models
  5. 2024Move Anything with Layered Scene Diffusion
  6. 2025MADI: Masking-Augmented Diffusion with Inference-Time Scaling for Visual Editing
  7. 2025OminiControl2: Efficient Conditioning for Diffusion Transformers
  8. 2026StructDiff: A Structure-Preserving and Spatially Controllable Diffusion Model for Single-Image Generation