MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Layered image generation and editing is a fundamental capability that enables layer-wise reuse, editing, and composition of generated visual content, analogous to word-level editing in natural language. Despite its importance, this remains an underexplored area at scale. To address this gap, we present MRT, a 20B-parameter masked region diffusion model tailored for multi-layer transparent image generation and editing, trained on over 10M multilingual design samples spanning diverse aspect ratios and textual prompts. To fully leverage this scale, we make two key technical contributions. First, we unify three complementary tasks including text-to-layers, image-to-layers, and layers-to-layers within a shared masked region diffusion framework, where selective token masking enables flexible layer-wise generation and editing. Second, to enable overflow layer generation, we introduce an overflow-aware canvas layer that handles boundary inconsistencies and supports semi-transparent background synthesis, enabling complete editable layers extending beyond visible canvas boundaries. Additionally, we apply diffusion distillation to achieve 8-step, real-time multi-layer generation with minimal quality degradation. Extensive experiments demonstrate that our framework substantially outperforms prior state-of-the-art approaches, including various commercial systems, across all three tasks, establishing a new benchmark for multi-layer transparent image generation. Notably, our model significantly outperforms the concurrent Qwen-Image-Layered model in image-to-layers quality according to user-study results, while achieving 10-100× faster inference and reducing activation GPU memory consumption by 50-90% during image-to-layer inference.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 67 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
24 of 67 references.
Closest ancestors · 5
Same direction, newest first
- 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Model10 Mar
- 2024SLayR: Scene Layout Generation with Rectified Flow6 Dec
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation16 Nov
- 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generation9 Oct
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul
Other references · 19
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2025Seedream 3.0 Technical Reportcited by 154
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
- 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 57
7 more
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
- 2024Graphic Design with Large Multimodal Modelcited by 40
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 34
- 2024Multimodal Markup Document Models for Graphic Design Completioncited by 16
- 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Modelscited by 15
- 2025Glance: Accelerating Diffusion Models with 1 Samplecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing
- 2026Masked Generative Transformer Is What You Need for Image Editing
- 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors
- 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Mode
- 2025MADI: Masking-Augmented Diffusion with Inference-Time Scaling for Visual Editing
- 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generation
- 2024Streamlining Image Editing with Layered Diffusion Brushes
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers