mlsanityData to 7 Oct 2026

Say Cheese! Detail-Preserving Portrait Collection Generation via Natural Language Edits

arXiv 2601.20511 ↗First posted 28 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

As social media platforms proliferate, users increasingly demand intuitive ways to create diverse, high-quality portrait collections. In this work, we introduce Portrait Collection Generation (PCG), a novel task that generates coherent portrait collections by editing a reference portrait image through natural language instructions. This task poses two unique challenges to existing methods: (1) complex multi-attribute modifications such as pose, spatial layout, and camera viewpoint; and (2) high-fidelity detail preservation including identity, clothing, and accessories. To address these challenges, we propose CHEESE, the first large-scale PCG dataset containing 24K portrait collections and 573K samples with high-quality modification text annotations, constructed through an Large Vison-Language Model-based pipeline with inversion-based verification. We further propose SCheese, a framework that combines text-guided generation with hierarchical identity and detail preservation. SCheese employs adaptive feature fusion mechanism to maintain identity consistency, and ConsistencyNet to inject fine-grained features for detail consistency. Comprehensive experiments validate the effectiveness of CHEESE in advancing PCG, with SCheese achieving state-of-the-art performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 37 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

33 of 37 references.

References · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2025Qwen2.5-VL Technical Reportcited by 5,418
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
21 more
  1. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  3. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  4. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  5. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  6. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  7. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  8. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
  9. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  10. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 210
  11. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  12. 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 166
  13. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  14. 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 102
  15. 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matchingcited by 60
  16. 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generationcited by 46
  17. 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30
  18. 2024EasyRef: Omni-Generalized Group Image Reference for Diffusion Models via Multimodal LLMcited by 25
  19. 2024Group Diffusion Transformers are Unsupervised Multitask Learnerscited by 22
  20. 2024IPAdapter-Instruct: Resolving Ambiguity in Image-based Conditioning using Instruct Promptscited by 18
  21. 2025CoTMR: Chain-of-Thought Multi-Scale Reasoning for Training-Free Zero-Shot Composed Image Retrievalcited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.