mlsanityData to 7 Oct 2026

DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Mode

arXiv 2503.12838 ↗First posted 17 Mar 2025cs.CVcited by 17

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-driven image generation using diffusion models has recently gained significant attention. To enable more flexible image manipulation and editing, recent research has expanded from single image generation to transparent layer generation and multi-layer compositions. However, existing approaches often fail to provide a thorough exploration of multi-layer structures, leading to inconsistent inter-layer interactions, such as occlusion relationships, spatial layout, and shadowing. In this paper, we introduce DreamLayer, a novel framework that enables coherent text-driven generation of multiple image layers, by explicitly modeling the relationship between transparent foreground and background layers. DreamLayer incorporates three key components, i.e., Context-Aware Cross-Attention (CACA) for global-local information exchange, Layer-Shared Self-Attention (LSSA) for establishing robust inter-layer connections, and Information Retained Harmonization (IRH) for refining fusion details at the latent level. By leveraging a coherent full-image context, DreamLayer builds inter-layer connections through attention mechanisms and applies a harmonization step to achieve seamless layer fusion. To facilitate research in multi-layer generation, we construct a high-quality, diverse multi-layer dataset including 400k samples. Extensive experiments and user studies demonstrate that DreamLayer generates more coherent and well-aligned layers, with broad applicability, including latent-space image editing and image-to-layer decomposition.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 49 references that are in the map. First posted on arXiv 17 Mar 2025.

Builds on

40 of 49 references.

Closest ancestors · 16

Same direction, newest first

  1. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Model18 Mar
  2. 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
  3. 2023DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection7 Sep
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  5. 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul
  6. 2023Conditional Text Image Generation with Diffusion Models19 Jun
  7. 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
  8. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  9. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  11. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
4 more
  1. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  2. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models26 Oct
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
12 more
  1. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  2. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  3. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  4. 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
  5. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  6. 2021Noise Estimation for Generative Diffusion Modelscited by 94
  7. 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpaintingcited by 40
  8. 2023Amodal Completion via Progressive Mixed Context Diffusioncited by 38
  9. 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
  10. 2024MIGC++: Advanced Multi-Instance Generation Controller for Image Synthesiscited by 35
  11. 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Modelscited by 22
  12. 2024DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editingcited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 12.

17 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors
  2. 2026MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
  3. 2025PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment
  4. 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Models
  5. 2024Training-free Composite Scene Generation for Layout-to-Image Synthesis
  6. 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editing
  7. 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models
  8. 2023R&B: Region and Boundary Aware Zero-shot Grounded Text-to-image Generation