mlsanityData to 7 Oct 2026

Cycle-Consistent Tuning for Layered Image Decomposition

arXiv 2602.20989 ↗First posted 24 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Disentangling visual layers in real-world images is a persistent challenge in vision and graphics, as such layers often involve non-linear and globally coupled interactions, including shading, reflection, and perspective distortion. In this work, we present an in-context image decomposition framework that leverages large diffusion foundation models for layered separation. We focus on the challenging case of logo-object decomposition, where the goal is to disentangle a logo from the surface on which it appears while faithfully preserving both layers. Our method fine-tunes a pretrained diffusion model via lightweight LoRA adaptation and introduces a cycle-consistent tuning strategy that jointly trains decomposition and composition models, enforcing reconstruction consistency between decomposed and recomposed images. This bidirectional supervision substantially enhances robustness in cases where the layers exhibit complex interactions. Furthermore, we introduce a progressive self-improving process, which iteratively augments the training set with high-quality model-generated examples to refine performance. Extensive experiments demonstrate that our approach achieves accurate and coherent decompositions and also generalizes effectively across other decomposition types, suggesting its potential as a unified framework for layered image decomposition.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 24 Feb 2026.

Builds on

42 of 51 references.

References · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2024GPT-4o System Cardcited by 4,467
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  11. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  12. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
30 more
  1. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  4. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  5. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  6. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
  7. 2022Visual Prompting via Image Inpaintingcited by 248
  8. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
  9. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  10. 2023SegGPT: Segmenting Everything In Contextcited by 193
  11. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
  12. 2024In-Context LoRA for Diffusion Transformerscited by 155
  13. 2023What Makes Good Examples for Visual In-Context Learning?cited by 150
  14. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  15. 2023In-Context Learning Unlocked for Diffusion Modelscited by 103
  16. 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
  17. 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
  18. 2023Intrinsic Image Decomposition via Ordinal Shadingcited by 53
  19. 2024Colorful Diffuse Intrinsic Image Decomposition in the Wildcited by 44
  20. 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learningcited by 39
  21. 2024Generative Image Layer Decomposition with Visual Effectscited by 33
  22. 2024Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Modelcited by 30
  23. 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
  24. 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
  25. 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 20
  26. 2023Measured Albedo in the Wild: Filling the Gap in Intrinsics Evaluationcited by 16
  27. 2024Compositional Image Decomposition with Diffusion Modelscited by 12
  28. 2023IMProv: Inpainting-based Multimodal Prompting for Computer Vision Taskscited by 10
  29. 2024RRM: Relightable assets using Radiance guided Material extractioncited by 3
  30. 2025AssetDropper: Asset Extraction via Diffusion Models with Reward-Driven Optimizationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis
  2. 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decomposition
  3. 2025LayerSync: Self-aligning Intermediate Layers
  4. 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition
  5. 2026PRISM: Latent Composition Consistency for Single-Image Reflection Removal
  6. 2024Move Anything with Layered Scene Diffusion
  7. 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining
  8. 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?