PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining
Not on the map. Why?
Abstract (arXiv)
Image-to-layer decomposition converts a flattened image into editable RGBA layers, enabling element-level editing in design workflows. Existing diffusion-based systems typically adapt large pretrained text-to-image (T2I) models and introduce RGBA autoencoders or variable-layer architectural modules. We revisit this design choice and ask whether layer decomposition truly requires these heavyweight components. We introduce PixelART, a pixel-space rectified-flow Transformer trained from scratch for image-to-layer (I2L) decomposition. PixelART directly denoises regional RGBA pixel patches using a single-stream multi-modal diffusion Transformer, avoiding RGBA-VAEs, pretrained T2I backbones, and layer-specific decoders. We identify a key property of the task: high-noise timesteps determine layer assignment and coarse layer organization, while low-noise timesteps mainly refine color, alpha, texture, and boundaries. Based on this observation, we propose a terminal-boosted timestep sampling strategy to increase training coverage in the high-noise layer assignment regime. Trained on 4M multi-layer design templates, PixelART achieves state-of-the-art layer decomposition and composite reconstruction on Design-Multi-Layer-Bench and LICA with over 80% fewer parameters, 98% lower latency, and 85% lower memory than the recent Qwen-Image-Layered model. Ablation experiments show that pixel-space x-prediction, terminal-boosted timestep sampling, and data/model scaling are critical, while T2I pretraining brings marginal benefits to the I2L task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 19 Sep 2026.
Builds on
47 of 61 references.
References · 47
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Segment Anythingcited by 8,234
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
35 more
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2023Segment Anything in High Qualitycited by 376
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 97
- 2025PixNerd: Pixel Neural Field Diffusioncited by 82
- 2024Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusioncited by 75
- 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 53
- 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
- 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 34
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
- 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 21
- 2025ChartGalaxy: A Dataset for Infographic Chart Understanding and Generationcited by 18
- 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Modecited by 17
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
- 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Modelscited by 15
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 13
- 2025Controllable Layer Decomposition for Reversible Multi-Layer Image Generationcited by 9
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 7
- 2026LICA: Layered Image Composition Annotations for Graphic Design Researchcited by 7
- 2025OmniAlpha: Aligning Transparency-Aware Generation via Multi-Task Unified Reinforcement Learningcited by 3
- 2026Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detectioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PixelDiT2: Representation-Grounded Pixel Diffusion Transformers
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generation
- 2026Pixel-Space Diffusion Transformers
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation
- 2026Inference-Time Loss-Guided Colour Preservation in Diffusion Sampling
- 2026A Frozen Pixel-Space Diffusion Model Can Guide Itself with Its Own Samples
- 2025DiP: Taming Diffusion Models in Pixel Space
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss