mlsanityData to 14 Oct 2026

Preserve Anything: Controllable Image Synthesis with Object Preservation

arXiv 2506.22531 ↗First posted 27 Jun 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce textitPreserve Anything, a novel method for controlled image synthesis that addresses key limitations in object preservation and semantic consistency in text-to-image (T2I) generation. Existing approaches often fail (i) to preserve multiple objects with fidelity, (ii) maintain semantic alignment with prompts, or (iii) provide explicit control over scene composition. To overcome these challenges, the proposed method employs an N-channel ControlNet that integrates (i) object preservation with size and placement agnosticism, color and detail retention, and artifact elimination, (ii) high-resolution, semantically consistent backgrounds with accurate shadows, lighting, and prompt adherence, and (iii) explicit user control over background layouts and lighting conditions. Key components of our framework include object preservation and background guidance modules, enforcing lighting consistency and a high-frequency overlay module to retain fine details while mitigating unwanted artifacts. We introduce a benchmark dataset consisting of 240K natural images filtered for aesthetic quality and 18K 3D-rendered synthetic images with metadata such as lighting, camera angles, and object relationships. This dataset addresses the deficiencies of existing benchmarks and allows a complete evaluation. Empirical results demonstrate that our method achieves state-of-the-art performance, significantly improving feature-space fidelity (FID 15.26) and semantic alignment (CLIP-S 32.85) while maintaining competitive aesthetic quality. We also conducted a user study to demonstrate the efficacy of the proposed work on unseen benchmark and observed a remarkable improvement of ~25%, ~19%, ~13%, and ~14% in terms of prompt alignment, photorealism, the presence of AI artifacts, and natural aesthetics over existing works.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 51 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

36 of 51 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  12. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
24 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  2. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  4. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  5. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  6. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  7. 2016Generative Adversarial Text to Image Synthesiscited by 735
  8. 2015Holistically-Nested Edge Detectioncited by 592
  9. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  10. 2017NIMA: Neural Image Assessmentcited by 389
  11. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
  12. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  13. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 200
  14. 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 154
  15. 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 144
  16. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
  17. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  18. 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpaintingcited by 40
  19. 2022From colouring-in to pointillism: revisiting semantic segmentation supervisioncited by 22
  20. 2024AnyControl: Create Your Artwork with Versatile Control on Text-to-Image Generationcited by 20
  21. 2024Shadow Generation for Composite Image Using Diffusion modelcited by 17
  22. 2024VirtualModel: Generating Object-ID-retentive Human-object Interaction Image by Diffusion Model for E-commerce Marketingcited by 15
  23. 2024AI-generated Image Quality Assessment in Visual Communicationcited by 7
  24. 2024InsertDiffusion: Identity Preserving Visualization of Objects through a Training-Free Diffusion Architecturecited by 5

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.