Cycle-Consistent Tuning for Layered Image Decomposition
Not on the map. Why?
Abstract (arXiv)
Disentangling visual layers in real-world images is a persistent challenge in vision and graphics, as such layers often involve non-linear and globally coupled interactions, including shading, reflection, and perspective distortion. In this work, we present an in-context image decomposition framework that leverages large diffusion foundation models for layered separation. We focus on the challenging case of logo-object decomposition, where the goal is to disentangle a logo from the surface on which it appears while faithfully preserving both layers. Our method fine-tunes a pretrained diffusion model via lightweight LoRA adaptation and introduces a cycle-consistent tuning strategy that jointly trains decomposition and composition models, enforcing reconstruction consistency between decomposed and recomposed images. This bidirectional supervision substantially enhances robustness in cases where the layers exhibit complex interactions. Furthermore, we introduce a progressive self-improving process, which iteratively augments the training set with high-quality model-generated examples to refine performance. Extensive experiments demonstrate that our approach achieves accurate and coherent decompositions and also generalizes effectively across other decomposition types, suggesting its potential as a unified framework for layered image decomposition.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
42 of 51 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
30 more
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
- 2022Visual Prompting via Image Inpaintingcited by 248
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2023SegGPT: Segmenting Everything In Contextcited by 193
- 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
- 2024In-Context LoRA for Diffusion Transformerscited by 155
- 2023What Makes Good Examples for Visual In-Context Learning?cited by 150
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2023In-Context Learning Unlocked for Diffusion Modelscited by 103
- 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
- 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
- 2023Intrinsic Image Decomposition via Ordinal Shadingcited by 53
- 2024Colorful Diffuse Intrinsic Image Decomposition in the Wildcited by 44
- 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learningcited by 39
- 2024Generative Image Layer Decomposition with Visual Effectscited by 33
- 2024Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Modelcited by 30
- 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
- 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
- 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 20
- 2023Measured Albedo in the Wild: Filling the Gap in Intrinsics Evaluationcited by 16
- 2024Compositional Image Decomposition with Diffusion Modelscited by 12
- 2023IMProv: Inpainting-based Multimodal Prompting for Computer Vision Taskscited by 10
- 2024RRM: Relightable assets using Radiance guided Material extractioncited by 3
- 2025AssetDropper: Asset Extraction via Diffusion Models with Reward-Driven Optimizationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decomposition
- 2025LayerSync: Self-aligning Intermediate Layers
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition
- 2026PRISM: Latent Composition Consistency for Single-Image Reflection Removal
- 2024Move Anything with Layered Scene Diffusion
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?