mlsanityData to 14 Oct 2026

UniWorld-Design: From Pixel Generation to Layer-Native Design

arXiv 2608.03971 ↗First posted 4 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA layers as the atomic units of generation, understanding, and editing. Our key insight is that pixels define how an image is rendered, whereas layers define how an image is created, understood, and edited. Just as human designers create and manipulate visual content through layers rather than raw pixels, UniWorld-Design equips multimodal generative models with a layer-native design space. UniWorld-Design comprises two models. The Text-to-RGBA (T2RGBA) model generates standalone RGBA assets directly from text. The Image-to-Layer (I2L) model conditions on a finished image, a global instruction and per-layer prompts, and jointly produces ordered, complete semantic RGBA layers. Its instruction interface supports top-level decomposition, recursive decomposition and targeted extraction, making layering an instruction-addressable operation for agentic editing. Because I2L learns complete semantic objects rather than visible-pixel partitions, its layers stay usable when moved or removed. On the Crello benchmark, I2L reduces per-layer RGB L1 error by 37% and achieves a 34% relative improvement in Alpha Soft IoU over Qwen-Image-Layered. Separately, T2RGBA achieves the highest CLIP Score, outperforming LayerDiffuse and OmniAlpha.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 39 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

34 of 39 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2025Qwen3-VL Technical Reportcited by 2,793
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  9. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  10. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  11. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
  12. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
22 more
  1. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  2. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  3. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
  4. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  5. 2022Highly Accurate Dichotomous Image Segmentationcited by 110
  6. 2015Semantic Amodal Segmentationcited by 103
  7. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
  8. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
  9. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  10. 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
  11. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  12. 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 34
  13. 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 32
  14. 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 21
  15. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
  16. 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Modelscited by 15
  17. 2025Unified Multimodal Models as Auto-Encoderscited by 13
  18. 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 13
  19. 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
  20. 2025OmniAlpha: Aligning Transparency-Aware Generation via Multi-Task Unified Reinforcement Learningcited by 3
  21. 2026Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learningcited by 1
  22. 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decompositioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object Integration
  2. 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layers
  3. 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation
  4. 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues
  5. 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation
  6. 2025Draw-In-Mind: Rebalancing Designer-Painter Roles in Unified Multimodal Models Benefits Image Editing
  7. 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generation
  8. 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence