Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Image compositing aims to seamlessly insert a foreground object into a background image, and recent advances in diffusion models have significantly enhanced the quality, especially when the foreground and background images come from the same domain (e.g., natural images). However, cross-domain compositing, where the foreground and background come from different domains, is underexplored and remains challenging because the model must preserve the foreground object's identity while stylizing it to match the background domain. Existing cross-domain compositing approaches largely rely on training-free blending and refinement strategies. This is partly due to the lack of large-scale paired datasets, limiting the development of training-based solutions. As a result, they are limited to tone-level alignment and often produce style-inconsistent or overstylized results. To overcome such limitations, we construct ChameleonDataset, the first large-scale training dataset for cross-domain compositing, with a comprehensive evaluation benchmark, built through a scalable data construction pipeline. Building on this, we propose Chameleon, a novel two-stage training-based cross-domain compositing framework. In the first stage, we propose Signed Style-Content Graph Learning (SSCGL) to train ChameleonEncoder, which effectively disentangles style and content representations. In the second stage, we introduce Style Gap-Aware Anisotropic Modulation (SGAM) into a diffusion transformer for effective cross-domain compositing, adaptively regulating how style tokens from the first-stage ChameleonEncoder are injected according to the foreground-background style gap, spatial region, and diffusion timestep. Our method outperforms state-of-the-art in-domain and cross-domain compositing models, sequential pipelines and commercial models, achieving improvements in both compositional plausibility and stylistic fidelity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 67 of its 88 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
67 of 88 references.
Closest ancestors · 17
Same direction, newest first
- 2025AIComposer: Any Style and Content Image Composition via Feature Integration28 Jul
- 2025Structure-Preserving Zero-Shot Image Editing via Stage-Wise Latent Injection in Diffusion Models22 Apr
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformer11 Apr
- 2024DiffuseST: Unleashing the Capability of the Diffusion Model for Style Transfer19 Oct
- 2024StyleTokenizer: Defining Image Style by a Single Instance for Controlling Diffusion Models4 Sep
- 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
- 2024TALE: Training-free Cross-domain Image Composition via Adaptive Latent Manipulation and Energy-guided Optimization7 Aug
- 2024Measuring Style Similarity in Diffusion Models1 Apr
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error31 Jan
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023Painterly Image Harmonization using Diffusion Model4 Aug
5 more
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition24 Jul
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
38 more
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2025DINOv3cited by 1,297
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2025Qwen-Image Technical Reportcited by 973
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2020Contrastive Learning with Hard Negative Samplescited by 619
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
- 2022The ArtBench Dataset: Benchmarking Generative Models with Artworkscited by 64
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024StyleShot: A Snapshot on Any Stylecited by 60
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
- 2021SDGNN: Learning Node Representation for Signed Directed Networkscited by 44
- 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
- 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
- 2024Magic Insert: Style-Aware Drag-and-Dropcited by 17
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
- 2023Towards a Unified Framework of Contrastive Learning for Disentangled Representationscited by 13
- 2025Precise Object and Effect Removal with Adaptive Target-Aware Attentioncited by 13
- 2022Painterly Image Harmonization in Dual Domainscited by 11
- 2023Foreground Object Search by Distilling Composite Image Featurecited by 6
- 2023Painterly Image Harmonization by Learning from Painterly Objectscited by 3
- 2026StyleDecoupler: Generalizable Artistic Style Disentanglementcited by 3
- 2025CareCom: Generative Image Composition with Calibrated Reference Featurescited by 2
- 2026Streamlined Open-Vocabulary Human-Object Interaction Detectioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Cross-domain Compositing with Pretrained Diffusion Models
- 2022ObjectStitch: Generative Object Compositing
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfer
- 2026PICS: Pairwise Image Compositing with Spatial Interactions
- 2025Domain-RAG: Retrieval-Guided Compositional Image Generation for Cross-Domain Few-Shot Object Detection
- 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Data
- 2024FDS: Feedback-guided Domain Synthesis with Multi-Source Conditional Diffusion Models for Domain Generalization
- 2025Leveraging Diffusion Models for Stylization using Multiple Style Images