mlsanityData to 7 Oct 2026

Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing

arXiv 2606.01079 ↗First posted 31 May 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Image compositing aims to seamlessly insert a foreground object into a background image, and recent advances in diffusion models have significantly enhanced the quality, especially when the foreground and background images come from the same domain (e.g., natural images). However, cross-domain compositing, where the foreground and background come from different domains, is underexplored and remains challenging because the model must preserve the foreground object's identity while stylizing it to match the background domain. Existing cross-domain compositing approaches largely rely on training-free blending and refinement strategies. This is partly due to the lack of large-scale paired datasets, limiting the development of training-based solutions. As a result, they are limited to tone-level alignment and often produce style-inconsistent or overstylized results. To overcome such limitations, we construct ChameleonDataset, the first large-scale training dataset for cross-domain compositing, with a comprehensive evaluation benchmark, built through a scalable data construction pipeline. Building on this, we propose Chameleon, a novel two-stage training-based cross-domain compositing framework. In the first stage, we propose Signed Style-Content Graph Learning (SSCGL) to train ChameleonEncoder, which effectively disentangles style and content representations. In the second stage, we introduce Style Gap-Aware Anisotropic Modulation (SGAM) into a diffusion transformer for effective cross-domain compositing, adaptively regulating how style tokens from the first-stage ChameleonEncoder are injected according to the foreground-background style gap, spatial region, and diffusion timestep. Our method outperforms state-of-the-art in-domain and cross-domain compositing models, sequential pipelines and commercial models, achieving improvements in both compositional plausibility and stylistic fidelity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 67 of its 88 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

67 of 88 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025AIComposer: Any Style and Content Image Composition via Feature Integration28 Jul
  2. 2025Structure-Preserving Zero-Shot Image Editing via Stage-Wise Latent Injection in Diffusion Models22 Apr
  3. 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformer11 Apr
  4. 2024DiffuseST: Unleashing the Capability of the Diffusion Model for Style Transfer19 Oct
  5. 2024StyleTokenizer: Defining Image Style by a Single Instance for Controlling Diffusion Models4 Sep
  6. 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
  7. 2024TALE: Training-free Cross-domain Image Composition via Adaptive Latent Manipulation and Energy-guided Optimization7 Aug
  8. 2024Measuring Style Similarity in Diffusion Models1 Apr
  9. 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error31 Jan
  10. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  12. 2023Painterly Image Harmonization using Diffusion Model4 Aug
5 more
  1. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition24 Jul
  2. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  4. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  8. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  10. 2023Segment Anythingcited by 8,158
  11. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  12. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
38 more
  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  6. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  8. 2025DINOv3cited by 1,297
  9. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  10. 2025Qwen-Image Technical Reportcited by 973
  11. 2025SAM 3: Segment Anything with Conceptscited by 835
  12. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  13. 2020Contrastive Learning with Hard Negative Samplescited by 619
  14. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  15. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  16. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
  17. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  18. 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
  19. 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
  20. 2022The ArtBench Dataset: Benchmarking Generative Models with Artworkscited by 64
  21. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  22. 2024StyleShot: A Snapshot on Any Stylecited by 60
  23. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  24. 2021SDGNN: Learning Node Representation for Signed Directed Networkscited by 44
  25. 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
  26. 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
  27. 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
  28. 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
  29. 2024Magic Insert: Style-Aware Drag-and-Dropcited by 17
  30. 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
  31. 2023Towards a Unified Framework of Contrastive Learning for Disentangled Representationscited by 13
  32. 2025Precise Object and Effect Removal with Adaptive Target-Aware Attentioncited by 13
  33. 2022Painterly Image Harmonization in Dual Domainscited by 11
  34. 2023Foreground Object Search by Distilling Composite Image Featurecited by 6
  35. 2023Painterly Image Harmonization by Learning from Painterly Objectscited by 3
  36. 2026StyleDecoupler: Generalizable Artistic Style Disentanglementcited by 3
  37. 2025CareCom: Generative Image Composition with Calibrated Reference Featurescited by 2
  38. 2026Streamlined Open-Vocabulary Human-Object Interaction Detectioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Cross-domain Compositing with Pretrained Diffusion Models
  2. 2022ObjectStitch: Generative Object Compositing
  3. 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfer
  4. 2026PICS: Pairwise Image Compositing with Spatial Interactions
  5. 2025Domain-RAG: Retrieval-Guided Compositional Image Generation for Cross-Domain Few-Shot Object Detection
  6. 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Data
  7. 2024FDS: Feedback-guided Domain Synthesis with Multi-Source Conditional Diffusion Models for Domain Generalization
  8. 2025Leveraging Diffusion Models for Stylization using Multiple Style Images