A Unified and Controllable Framework for Layered Image Generation with Visual Effects
Not on the map. Why?
Abstract (arXiv)
Recent image generation models produce impressive composites, but often fail to preserve the identity of user-provided content when editing specific elements: the surrounding scene may shift, and even the edited object's appearance can drift from the original. Layered representation offer a natural remedy--they allow users to independently manipulate individual elements--but existing layered methods typically produce transparent foregrounds without realistic visual effects such as shadows and reflections, forcing the use of a second harmonization model after every edit, which in turn introduces drift. To overcome these limitations, we present LASAGNA, which generates a photorealistic background (BG) and an RGBA foreground with compelling visual effects in a single forward pass. By treating object-associated visual effects as part of the foreground (FG) layer, LASAGNA supports the dominant class of consumer edits (e.g., translation, scaling, recoloring, duplication) via alpha compositing alone, without invoking any model post-edit, thereby eliminating identity drift introduced by cascade editing pipelines. This single-pass design contrasts with prior layered methods that rely on separate expert models for each task. LASAGNA handles diverse conditional inputs--text prompts, FG, BG, and location masks--within a unified architecture. We further release two community resources: LASAGNA-48K, the first public dataset of 48K layered image triplets with photorealistic visual effects, and LASAGNA-BENCH, the first standardized benchmark for layer-centric generation and editing, comprising 242 expert-annotated samples across six diverse sources. Experiments show that LASAGNA outperforms both general-purpose editors and prior layered methods across three generation modes, and supports a wide range of post-edits without any model re-inference.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 63 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
54 of 63 references.
References · 54
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
- 2025OmniEraser: Remove Objects and Their Effects in Images with Paired Video-Frame Datacited by 37
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2024Generative Image Layer Decomposition with Visual Effectscited by 34
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 34
- 2024Multi-Scale and Detail-Enhanced Segment Anything Model for Salient Object Detectioncited by 30
- 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
- 2022Instance Shadow Detection with A Single-Stage Detectorcited by 22
- 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priorscited by 19
- 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Modecited by 17
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.