mlsanityData to 14 Oct 2026

PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining

arXiv 2609.22789 ↗First posted 19 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Image-to-layer decomposition converts a flattened image into editable RGBA layers, enabling element-level editing in design workflows. Existing diffusion-based systems typically adapt large pretrained text-to-image (T2I) models and introduce RGBA autoencoders or variable-layer architectural modules. We revisit this design choice and ask whether layer decomposition truly requires these heavyweight components. We introduce PixelART, a pixel-space rectified-flow Transformer trained from scratch for image-to-layer (I2L) decomposition. PixelART directly denoises regional RGBA pixel patches using a single-stream multi-modal diffusion Transformer, avoiding RGBA-VAEs, pretrained T2I backbones, and layer-specific decoders. We identify a key property of the task: high-noise timesteps determine layer assignment and coarse layer organization, while low-noise timesteps mainly refine color, alpha, texture, and boundaries. Based on this observation, we propose a terminal-boosted timestep sampling strategy to increase training coverage in the high-noise layer assignment regime. Trained on 4M multi-layer design templates, PixelART achieves state-of-the-art layer decomposition and composite reconstruction on Design-Multi-Layer-Bench and LICA with over 80% fewer parameters, 98% lower latency, and 85% lower memory than the recent Qwen-Image-Layered model. Ablation experiments show that pixel-space x-prediction, terminal-boosted timestep sampling, and data/model scaling are critical, while T2I pretraining brings marginal benefits to the I2L task.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 19 Sep 2026.

Builds on

47 of 61 references.

References · 47

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023Segment Anythingcited by 8,234
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
35 more
  1. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  4. 2025Qwen-Image Technical Reportcited by 1,044
  5. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  6. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  7. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  8. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  9. 2023Segment Anything in High Qualitycited by 376
  10. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  11. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  12. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
  13. 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 97
  14. 2025PixNerd: Pixel Neural Field Diffusioncited by 82
  15. 2024Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusioncited by 75
  16. 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 53
  17. 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
  18. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  19. 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
  20. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
  21. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  22. 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 34
  23. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
  24. 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 21
  25. 2025ChartGalaxy: A Dataset for Infographic Chart Understanding and Generationcited by 18
  26. 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Modecited by 17
  27. 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
  28. 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Modelscited by 15
  29. 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 13
  30. 2025Controllable Layer Decomposition for Reversible Multi-Layer Image Generationcited by 9
  31. 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
  32. 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 7
  33. 2026LICA: Layered Image Composition Annotations for Graphic Design Researchcited by 7
  34. 2025OmniAlpha: Aligning Transparency-Aware Generation via Multi-Task Unified Reinforcement Learningcited by 3
  35. 2026Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detectioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PixelDiT2: Representation-Grounded Pixel Diffusion Transformers
  2. 2025PixelDiT: Pixel Diffusion Transformers for Image Generation
  3. 2026Pixel-Space Diffusion Transformers
  4. 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation
  5. 2026Inference-Time Loss-Guided Colour Preservation in Diffusion Sampling
  6. 2026A Frozen Pixel-Space Diffusion Model Can Guide Itself with Its Own Samples
  7. 2025DiP: Taming Diffusion Models in Pixel Space
  8. 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss