mlsanityData to 7 Oct 2026

Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfer

arXiv 2104.01867 ↗First posted 5 Apr 2021cs.CVcited by 35

Not on the map. Why?

Abstract (arXiv)

Makeup transfer is the task of applying on a source face the makeup style from a reference image. Real-life makeups are diverse and wild, which cover not only color-changing but also patterns, such as stickers, blushes, and jewelries. However, existing works overlooked the latter components and confined makeup transfer to color manipulation, focusing only on light makeup styles. In this work, we propose a holistic makeup transfer framework that can handle all the mentioned makeup components. It consists of an improved color transfer branch and a novel pattern transfer branch to learn all makeup properties, including color, shape, texture, and location. To train and evaluate such a system, we also introduce new makeup datasets for real and synthetic extreme makeup. Experimental results show that our framework achieves the state of the art performance on both light and extreme makeup styles. Code is available at https://github.com/VinAIResearch/CPM.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 15 of its 34 references that are in the map. First posted on arXiv 5 Apr 2021.

Builds on

15 of 34 references.

References · 15

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  3. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  4. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  5. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  6. 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
  7. 2018Nonlinear 3D Face Morphable Modelcited by 157
  8. 2018Face Alignment in Full Pose Range: A 3D Total Solutioncited by 147
  9. 2016Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Networkcited by 109
  10. 2019PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfercited by 66
  11. 20163D Face Reconstruction by Learning from Synthetic Datacited by 64
  12. 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 63
3 more
  1. 2019Photo-Realistic Facial Details Synthesis from Single Imagecited by 40
  2. 2020CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfercited by 15
  3. 2019Disentangled Makeup Transfer with Generative Adversarial Networkcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 7; 2023: 4; 2024: 9; 2025: 8; 2026: 5.

35 papers.

Sort:

By area:

  1. 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Modelcited by 44
  2. 2021SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removalcited by 22
  3. 2022BeautyREC: Robust, Efficient, and Content-preserving Makeup Transfercited by 16
  4. 2024Content-Style Decoupling for Unsupervised Makeup Transfer without Generating Pseudo Ground Truthcited by 15
  5. 2024GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Imagecited by 12
  6. 2022BareSkinNet: De-makeup and De-lighting via 3D Face Reconstructioncited by 10
  7. 2024SHMT: Self-supervised Hierarchical Makeup Transfer via Latent Diffusion Modelscited by 10
  8. 2023Makeup Extraction of 3D Representation via Illumination-Aware Image Decompositioncited by 8
  9. 2021Deep Face Video Inpainting via UV Mappingcited by 7
  10. 2024Makeup Prior Models for 3D Facial Makeup Estimation and Applicationscited by 7
  11. 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 7
  12. 2025MAD: Makeup All-in-One with Cross-Domain Diffusion Modelcited by 5
23 more
  1. 2025FLUX-Makeup: High-Fidelity, Identity-Consistent, and Robust Makeup Transfer via Diffusion Transformercited by 5
  2. 2024BeautyBank: Encoding Facial Makeup in Latent Spacecited by 4
  3. 2022Modern Augmented Reality: Applications, Trends, and Future Directionscited by 3
  4. 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networkscited by 3
  5. 2023Let's Get the FACS Straight -- Reconstructing Obstructed Facial Featurescited by 3
  6. 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatarscited by 3
  7. 2022Robust Deepfake On Unrestricted Media: Generation And Detectioncited by 2
  8. 2022Real-time Virtual-Try-On from a Single Example Image through Deep Inverse Graphics and Learned Differentiable Rendererscited by 2
  9. 2023SARA: Controllable Makeup Transfer with Spatial Alignment and Region-Adaptive Normalizationcited by 2
  10. 2025FFHQ-Makeup: Paired Synthetic Makeup Dataset with Facial Consistency Across Multiple Stylescited by 2
  11. 2025EvoMakeup: High-Fidelity and Controllable Makeup Editing with MakeupQuadcited by 2
  12. 2022Flexible Portrait Image Editing with Fine-Grained Controlcited by 1
  13. 2024Gorgeous: Create Your Desired Character Facial Makeup from Any Ideascited by 1
  14. 2024V-LASIK: Consistent Glasses-Removal from Videos Using Synthetic Datacited by 1
  15. 2026Supervised makeup transfer with a curated dataset: Decoupling identity and makeup features for enhanced transformationcited by 1
  16. 2023Enhancing Face Recognition with Latent Space Data Augmentation and Facial Posture Reconstructioncited by 0
  17. 2025Scalable and Realistic Virtual Try-on Application for Foundation Makeup with Kubelka-Munk Theorycited by 0
  18. 2025DiffClean: Diffusion-based Makeup Removal for Accurate Age Estimationcited by 0
  19. 2025Towards High-Fidelity, Identity-Preserving Real-Time Makeup Transfer: Decoupling Style Generationcited by 0
  20. 2026Diffusion-Based Makeup Transfer with Facial Region-Aware Makeup Featurescited by 0
  21. 2026From Synthetic to Real: Toward Identity-Consistent Makeup Transfer with Synthetic and Real Datacited by 0
  22. 2026MakeupMirror: Improving Facial Attribute Preservation in Diffusion Models for Makeup Transfercited by 0
  23. 2026MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfercited by 0