mlsanityData to 7 Oct 2026

Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model

arXiv 2403.07764 ↗First posted 12 Mar 2024cs.CVcited by 44

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Current makeup transfer methods are limited to simple makeup styles, making them difficult to apply in real-world scenarios. In this paper, we introduce Stable-Makeup, a novel diffusion-based makeup transfer method capable of robustly transferring a wide range of real-world makeup, onto user-provided faces. Stable-Makeup is based on a pre-trained diffusion model and utilizes a Detail-Preserving (D-P) makeup encoder to encode makeup details. It also employs content and structural control modules to preserve the content and structural information of the source image. With the aid of our newly added makeup cross-attention layers in U-Net, we can accurately transfer the detailed makeup to the corresponding position in the source image. After content-structure decoupling training, Stable-Makeup can maintain content and the facial structure of the source image. Moreover, our method has demonstrated strong robustness and generalizability, making it applicable to varioustasks such as cross-domain makeup transfer, makeup-guided text-to-image generation and so on. Extensive experiments have demonstrated that our approach delivers state-of-the-art (SOTA) results among existing makeup transfer methods and exhibits a highly promising with broad potential applications in various related fields. Code released: https://github.com/Xiaojiu-z/Stable-Makeup

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 49 of its 60 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

49 of 60 references.

Closest ancestors · 18

Same direction, newest first

  1. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
  2. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  3. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models5 Jul
  4. 2023LEDITS: Real Image Editing with DDPM Inversion and Semantic Guidance2 Jul
  5. 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models30 May
  6. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models25 May
  7. 2023iEdit: Localised Text-guided Image Editing with Weak Supervision10 May
  8. 2023Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Models5 Apr
  9. 2023Directed Diffusion: Direct Control of Object Placement through Attention Guidance25 Feb
  10. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb
  11. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
6 more
  1. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
  2. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Models8 Dec
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  6. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 31

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
19 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  2. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  3. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  4. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  5. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
  6. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
  7. 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
  8. 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 77
  9. 2019PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfercited by 66
  10. 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 63
  11. 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfercited by 35
  12. 2023Edit Everything: A Text-Guided Generative System for Images Editingcited by 33
  13. 2022EleGANt: Exquisite and Locally Editable GAN for Makeup Transfercited by 28
  14. 2022Shape Preserving Facial Landmarks with Graph Attention Networkscited by 23
  15. 2021Facial Attribute Transformers for Precise and Robust Makeup Transfercited by 17
  16. 2021PSGAN++: Robust Detail-Preserving Makeup Transfer and Removalcited by 17
  17. 2022BeautyREC: Robust, Efficient, and Content-preserving Makeup Transfercited by 16
  18. 2020CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfercited by 15
  19. 2022Semi-parametric Makeup Transfer via Semantic-aware Correspondencecited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 29; 2026: 6.

44 papers.

Sort:

By area:

  1. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  2. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 62
  3. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  4. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  5. 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 43
  6. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  7. 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generationcited by 43
  8. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  9. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 34
  10. 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Datacited by 32
  11. 2025RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformerscited by 26
  12. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
32 more
  1. 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 23
  2. 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
  3. 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 11
  4. 2024SHMT: Self-supervised Hierarchical Makeup Transfer via Latent Diffusion Modelscited by 10
  5. 2025FreeUV: Ground-Truth-Free Realistic Facial UV Texture Recovery via Cross-Assembly Inference Strategycited by 7
  6. 2025FLUX-Makeup: High-Fidelity, Identity-Consistent, and Robust Makeup Transfer via Diffusion Transformercited by 5
  7. 2025OmniRefiner: Reinforcement-Guided Local Diffusion Refinementcited by 5
  8. 2024Foodfusion: A Novel Approach for Food Image Composition via Diffusion Modelscited by 4
  9. 2024Oscillation Inversion: Understand the structure of Large Flow Model through the Lens of Inversion Methodcited by 4
  10. 2024BeautyBank: Encoding Facial Makeup in Latent Spacecited by 4
  11. 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceiverscited by 4
  12. 2025NumeriKontrol: Adding Numeric Control to Diffusion Transformers for Instruction-based Image Editingcited by 4
  13. 2025IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learningcited by 4
  14. 2025SEED: A Benchmark Dataset for Sequential Facial Attribute Editing with Diffusion Modelscited by 3
  15. 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatarscited by 3
  16. 2025Loom: Diffusion-Transformer for Interleaved Generationcited by 3
  17. 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editingcited by 3
  18. 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Modelcited by 2
  19. 2025FFHQ-Makeup: Paired Synthetic Makeup Dataset with Facial Consistency Across Multiple Stylescited by 2
  20. 2025EvoMakeup: High-Fidelity and Controllable Makeup Editing with MakeupQuadcited by 2
  21. 2025Durian: Dual Reference Image-Guided Portrait Animation with Attribute Transfercited by 1
  22. 2025DreamMakeup: Face Makeup Customization using Latent Diffusion Modelscited by 1
  23. 2025Image Generation as a Visual Planner for Robotic Manipulationcited by 1
  24. 2025TokenPure: Watermark Removal through Tokenized Appearance and Structural Guidancecited by 1
  25. 2026Supervised makeup transfer with a curated dataset: Decoupling identity and makeup features for enhanced transformationcited by 1
  26. 2025DiffClean: Diffusion-based Makeup Removal for Accurate Age Estimationcited by 0
  27. 2025Towards High-Fidelity, Identity-Preserving Real-Time Makeup Transfer: Decoupling Style Generationcited by 0
  28. 2025GenKOL: Modular Generative AI Framework For Scalable Virtual KOL Generationcited by 0
  29. 2026Diffusion-Based Makeup Transfer with Facial Region-Aware Makeup Featurescited by 0
  30. 2026From Synthetic to Real: Toward Identity-Consistent Makeup Transfer with Synthetic and Real Datacited by 0
  31. 2026MakeupMirror: Improving Facial Attribute Preservation in Diffusion Models for Makeup Transfercited by 0
  32. 2026MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfercited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MAD: Makeup All-in-One with Cross-Domain Diffusion Model
  2. 2026A training-free framework for high-fidelity appearance transfer via diffusion transformers
  3. 2024What to Preserve and What to Transfer: Faithful, Identity-Preserving Diffusion-based Hairstyle Transfer
  4. 2025Face-MakeUp: Multimodal Facial Prompts for Text-to-Image Generation
  5. 2023When StyleGAN Meets Stable Diffusion: a mathscrW_+ Adapter for Personalized Image Generation
  6. 2024Toward Tiny and High-quality Facial Makeup with Data Amplify Learning
  7. 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors
  8. 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning