DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Mode
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-driven image generation using diffusion models has recently gained significant attention. To enable more flexible image manipulation and editing, recent research has expanded from single image generation to transparent layer generation and multi-layer compositions. However, existing approaches often fail to provide a thorough exploration of multi-layer structures, leading to inconsistent inter-layer interactions, such as occlusion relationships, spatial layout, and shadowing. In this paper, we introduce DreamLayer, a novel framework that enables coherent text-driven generation of multiple image layers, by explicitly modeling the relationship between transparent foreground and background layers. DreamLayer incorporates three key components, i.e., Context-Aware Cross-Attention (CACA) for global-local information exchange, Layer-Shared Self-Attention (LSSA) for establishing robust inter-layer connections, and Information Retained Harmonization (IRH) for refining fusion details at the latent level. By leveraging a coherent full-image context, DreamLayer builds inter-layer connections through attention mechanisms and applies a harmonization step to achieve seamless layer fusion. To facilitate research in multi-layer generation, we construct a high-quality, diverse multi-layer dataset including 400k samples. Extensive experiments and user studies demonstrate that DreamLayer generates more coherent and well-aligned layers, with broad applicability, including latent-space image editing and image-to-layer decomposition.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 49 references that are in the map. First posted on arXiv 17 Mar 2025.
Builds on
40 of 49 references.
Closest ancestors · 16
Same direction, newest first
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Model18 Mar
- 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
- 2023DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection7 Sep
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul
- 2023Conditional Text Image Generation with Diffusion Models19 Jun
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
4 more
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models26 Oct
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
Other references · 24
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
12 more
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2021Noise Estimation for Generative Diffusion Modelscited by 94
- 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpaintingcited by 40
- 2023Amodal Completion via Progressive Mixed Context Diffusioncited by 38
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2024MIGC++: Advanced Multi-Instance Generation Controller for Image Synthesiscited by 35
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Modelscited by 22
- 2024DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editingcited by 19
Built on by
Citing papers per year: 2025: 5; 2026: 12.
17 papers.
Sort:
By area:
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 8
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 6
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generationcited by 5
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformerscited by 5
- 2026Referring Layer Decompositioncited by 3
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Modelcited by 2
- 2026See-through: Single-image Layer Decomposition for Anime Characterscited by 2
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Productioncited by 1
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Priorcited by 1
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
5 more
- 2026Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learningcited by 1
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effectscited by 0
- 2026TransText: Alpha-as-RGB Representation for Transparent Text Animationcited by 0
- 2026LiWi: Layering in the Wildcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretrainingcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining19 Sep 2026
- 2026Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learning28 May 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026LiWi: Layering in the Wild14 May 2026
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layers21 Apr 2026
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior19 Apr 2026
- 2026TransText: Alpha-as-RGB Representation for Transparent Text Animation18 Mar 2026
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Production16 Mar 2026
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers6 Mar 2026
- 2026Referring Layer Decomposition22 Feb 2026
- 2026See-through: Single-image Layer Decomposition for Anime Characters3 Feb 2026
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effects21 Jan 2026
5 more
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decomposition17 Dec 2025
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation9 Nov 2025
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Model4 Nov 2025
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner29 Sep 2025
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformer11 Apr 2025
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformerscited by 5
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Modelcited by 2
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Priorcited by 1
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior19 Apr 2026
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers6 Mar 2026
- 2025TAUE: Training-free Noise Transplant and Cultivation Diffusion Model4 Nov 2025
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformer11 Apr 2025
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 8
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 6
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generationcited by 5
- 2026Referring Layer Decompositioncited by 3
- 2026See-through: Single-image Layer Decomposition for Anime Characterscited by 2
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Productioncited by 1
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effectscited by 0
- 2026TransText: Alpha-as-RGB Representation for Transparent Text Animationcited by 0
- 2026LiWi: Layering in the Wildcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretrainingcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining19 Sep 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026LiWi: Layering in the Wild14 May 2026
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layers21 Apr 2026
- 2026TransText: Alpha-as-RGB Representation for Transparent Text Animation18 Mar 2026
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Production16 Mar 2026
- 2026Referring Layer Decomposition22 Feb 2026
- 2026See-through: Single-image Layer Decomposition for Anime Characters3 Feb 2026
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effects21 Jan 2026
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decomposition17 Dec 2025
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation9 Nov 2025
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner29 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors
- 2026MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
- 2025PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment
- 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Models
- 2024Training-free Composite Scene Generation for Layout-to-Image Synthesis
- 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editing
- 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models
- 2023R&B: Region and Boundary Aware Zero-shot Grounded Text-to-image Generation