mlsanityData to 14 Oct 2026

Geometry-Editable and Appearance-Preserving Object Compositon

arXiv 2505.20914 ↗First posted 27 May 2025cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

General object composition (GOC) aims to seamlessly integrate a target object into a background scene with desired geometric properties, while simultaneously preserving its fine-grained appearance details. Recent approaches derive semantic embeddings and integrate them into advanced diffusion models to enable geometry-editable generation. However, these highly compact embeddings encode only high-level semantic cues and inevitably discard fine-grained appearance details. We introduce a Disentangled Geometry-editable and Appearance-preserving Diffusion (DGAD) model that first leverages semantic embeddings to implicitly capture the desired geometric transformations and then employs a cross-attention retrieval mechanism to align fine-grained appearance features with the geometry-edited representation, facilitating both precise geometry editing and faithful appearance preservation in object composition. Specifically, DGAD builds on CLIP/DINO-derived and reference networks to extract semantic embeddings and appearance-preserving representations, which are then seamlessly integrated into the encoding and decoding pipelines in a disentangled manner. We first integrate the semantic embeddings into pre-trained diffusion models that exhibit strong spatial reasoning capabilities to implicitly capture object geometry, thereby facilitating flexible object manipulation and ensuring effective editability. Then, we design a dense cross-attention mechanism that leverages the implicitly learned object geometry to retrieve and spatially align appearance features with their corresponding regions, ensuring faithful appearance consistency. Extensive experiments on public benchmarks demonstrate the effectiveness of the proposed DGAD framework.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 49 of its 66 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

49 of 66 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation3 Mar
  2. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan
  3. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion11 Mar

Other references · 46

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  12. 2023Qwen Technical Reportcited by 3,344
34 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  2. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  3. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  5. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  6. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  7. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  8. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  9. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  10. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  11. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  12. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  13. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  14. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  15. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
  16. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  17. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  18. 2024Zero-shot Image Editing with Reference Imitationcited by 65
  19. 2017GP-GAN: Towards Realistic High-Resolution Image Blendingcited by 64
  20. 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
  21. 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
  22. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  23. 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
  24. 2022DCCF: Deep Comprehensible Color Filter Learning Framework for High-Resolution Image Harmonizationcited by 46
  25. 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
  26. 2024DreamOmni: Unified Image Generation and Editingcited by 30
  27. 2023LaMD: Latent Motion Diffusion for Image-Conditional Video Generationcited by 22
  28. 2020Deep Image Compositingcited by 21
  29. 2023MaskDiffusion: Boosting Text-to-Image Consistency with Conditional Maskcited by 17
  30. 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 10
  31. 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulationcited by 7
  32. 2023Warping the Residuals for Image Editing with StyleGANcited by 6
  33. 2025Exploiting Temporal Audio-Visual Correlation Embedding for Audio-Driven One-Shot Talking Head Animationcited by 4
  34. 2024Diffusion-Enhanced Test-time Adaptation with Text and Image Augmentationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026PICS: Pairwise Image Compositing with Spatial Interactions
  2. 2025Layout2Scene: 3D Semantic Layout Guided Scene Generation via Geometry and Appearance Diffusion Priors
  3. 2025Geometry-Aware Diffusion Models for Multiview Scene Inpainting
  4. 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
  5. 2025SceneCompleter: Dense 3D Scene Completion for Generative Novel View Synthesis
  6. 2024SSEditor: Controllable Mask-to-Scene Generation with Diffusion Model
  7. 2026A training-free framework for high-fidelity appearance transfer via diffusion transformers
  8. 2026GOT-Edit: Geometry-Aware Generic Object Tracking via Online Model Editing