MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Makeup-transfer applies the reference makeup to the source face while preserving the source identity. Despite advances in full-face editing by diffusion-based methods, strong regional controllability, makeup fidelity, and identity preservation remain challenging. The reasons are (i) pixel-to-attention misalignment that causes spillover into non-target areas and weakens regional control; (ii) unclear transfer/preservation concept separation under two-image conditioning, leading to coupling between makeup attributes and identity; and (iii) the lack of a high-resolution dataset that is identity-consistent and region-labeled for fine-grained supervision. In this paper, we propose MagicMakeup, a diffusion transformer-based framework for region-controllable and high-fidelity makeup transfer, built on spatial constraints and concept disentanglement. To enable precise region-specific editing while preserving identity, we propose Token-Aligned Region Gating, which aligns pixel masks with attention and applies region-specific logit gating. To clarify the concepts of transfer and preservation, we further introduce Cross-Modal Perception Guidance, which aligns text and image features to enhance cross-modal concept perception. We also design a pipeline for the generation of 1024 x 1024 data pairs through region-specific makeup removal and establish a unified benchmark in synthetic and real settings. Extensive quantitative and qualitative experiments show that MagicMakeup improves regional controllability, makeup fidelity, and identity preservation, with strong robustness across styles, races, and poses.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 43 of its 48 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
43 of 48 references.
Closest ancestors · 18
Same direction, newest first
- 2025FLUX-Makeup: High-Fidelity, Identity-Consistent, and Robust Makeup Transfer via Diffusion Transformer7 Aug
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
- 2025MAD: Makeup All-in-One with Cross-Domain Diffusion Model3 Apr
- 2024SHMT: Self-supervised Hierarchical Makeup Transfer via Latent Diffusion Models15 Dec
- 2024DiT4Edit: Diffusion Transformer for Image Editing5 Nov
- 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model12 Mar
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb
- 2023High-Fidelity Diffusion-based Image Editing25 Dec
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models11 Dec
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models5 Jul
- 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Models30 May
6 more
- 2023iEdit: Localised Text-guided Image Editing with Weak Supervision10 May
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classification17 Apr
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
- 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Models8 Dec
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
Other references · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2025Qwen-Image Technical Reportcited by 973
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
- 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
- 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 72
13 more
- 2019PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfercited by 66
- 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 63
- 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 37
- 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfercited by 35
- 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protectioncited by 31
- 20243D-SceneDreamer: Text-Driven 3D-Consistent Scene Generationcited by 29
- 2022EleGANt: Exquisite and Locally Editable GAN for Makeup Transfercited by 28
- 2021SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removalcited by 22
- 2020SCGAN: Saliency Map-guided Colorization with Generative Adversarial Networkcited by 18
- 2021PSGAN++: Robust Detail-Preserving Makeup Transfer and Removalcited by 17
- 2022BeautyREC: Robust, Efficient, and Content-preserving Makeup Transfercited by 16
- 2024Content-Style Decoupling for Unsupervised Makeup Transfer without Generating Pseudo Ground Truthcited by 15
- 2024BeautyBank: Encoding Facial Makeup in Latent Spacecited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Supervised makeup transfer with a curated dataset: Decoupling identity and makeup features for enhanced transformation
- 2026When Diffusion Models Forget Who You Are: Identity Preservation in Face Inpainting under Large Occlusions
- 2026MakeupMirror: Improving Facial Attribute Preservation in Diffusion Models for Makeup Transfer
- 2025DreamMakeup: Face Makeup Customization using Latent Diffusion Models
- 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning
- 2026A training-free framework for high-fidelity appearance transfer via diffusion transformers
- 2026MMFace-DiT: A Dual-Stream Diffusion Transformer for High-Fidelity Multimodal Face Generation
- 2025LaTo: Landmark-tokenized Diffusion Transformer for Fine-grained Human Face Editing