PICS: Pairwise Image Compositing with Spatial Interactions
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Despite strong single-turn performance, diffusion-based image compositing often struggles to preserve coherent spatial relations in pairwise or sequential edits, where subsequent insertions may overwrite previously generated content and disrupt physical consistency. We introduce PICS, a self-supervised composition-by-decomposition paradigm that composes objects in parallel while explicitly modeling the compositional interactions among (fully-/partially-)visible objects and background. At its core, an Interaction Transformer employs mask-guided Mixture-of-Experts to route background, exclusive, and overlap regions to dedicated experts, with an adaptive α-blending strategy that infers a compatibility-aware fusion of overlapping objects while preserving boundary fidelity. To further enhance robustness to geometric variations, we incorporate geometry-aware augmentations covering both out-of-plane and in-plane pose changes of objects. Our method delivers superior pairwise compositing quality and substantially improved stability, with extensive evaluations across virtual try-on, indoor, and street scene settings showing consistent gains over state-of-the-art baselines. Code and data are available at https://github.com/RyanHangZhou/PICS
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 53 of its 71 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
53 of 71 references.
Closest ancestors · 3
Same direction, newest first
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Rendering11 Aug
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting11 Mar
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
Other references · 50
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
38 more
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2017Deep Image Harmonizationcited by 120
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2015Semantic Amodal Segmentationcited by 102
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
- 2020Self-Supervised Scene De-occlusioncited by 96
- 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 78
- 2018Spatial Fusion GAN for Image Synthesiscited by 68
- 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generationcited by 68
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024TripletCLIP: Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negativescited by 57
- 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
- 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generationcited by 46
- 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2023BotChat: Evaluating LLMs' Capabilities of Having Multi-Turn Dialoguescited by 34
- 2024EasyHOI: Unleashing the Power of Large Models for Reconstructing Hand-Object Interactions in the Wildcited by 33
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2019Learning Instance Occlusion for Panoptic Segmentationcited by 30
- 2020Learning Object Permanence from Videocited by 29
- 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Modelscited by 19
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
- 2024Open-World Amodal Appearance Completioncited by 18
- 2024Object-level Scene Deocclusioncited by 17
- 2025Multi-turn Consistent Image Editingcited by 17
- 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Priorcited by 16
- 2025CoSTAast: Cost-Sensitive Toolpath Agent for Multi-turn Image Editingcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022ObjectStitch: Generative Object Compositing
- 2025Geometry-Editable and Appearance-Preserving Object Compositon
- 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generation
- 2025BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?
- 2023Cross-domain Compositing with Pretrained Diffusion Models
- 2024BIFR"OST: 3D-Aware Image compositing with Language Instructions
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusion