Gorgeous: Create Your Desired Character Facial Makeup from Any Ideas
Not on the map. Why?
Abstract (arXiv)
Contemporary makeup transfer methods primarily focus on replicating makeup from one face to another, considerably limiting their use in creating diverse and creative character makeup essential for visual storytelling. Such methods typically fail to address the need for uniqueness and contextual relevance, specifically aligning with character and story settings as they depend heavily on existing facial makeup in reference images. This approach also presents a significant challenge when attempting to source a perfectly matched facial makeup style, further complicating the creation of makeup designs inspired by various story elements, such as theme, background, and props that do not necessarily feature faces. To address these limitations, we introduce Gorgeous, a novel diffusion-based makeup application method that goes beyond simple transfer by innovatively crafting unique and thematic facial makeup. Unlike traditional methods, Gorgeous does not require the presence of a face in the reference images. Instead, it draws artistic inspiration from a minimal set of three to five images, which can be of any type, and transforms these elements into practical makeup applications directly on the face. Our comprehensive experiments demonstrate that Gorgeous can effectively generate distinctive character facial makeup inspired by the chosen thematic reference images. This approach opens up new possibilities for integrating broader story elements into character makeup, thereby enhancing the narrative depth and visual impact in storytelling.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 65 of its 103 references that are in the map. First posted on arXiv 22 Apr 2024.
Builds on
65 of 103 references.
References · 65
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
38 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
- 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2017Neural Style Transfer: A Reviewcited by 199
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
- 2017Demystifying Neural Style Transfercited by 152
- 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
- 2017Visual Attribute Transfer through Deep Image Analogycited by 123
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
- 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
- 2020Arbitrary Style Transfer via Multi-Adaptation Networkcited by 70
- 2019PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfercited by 66
- 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
- 2024Efficient Diffusion Model for Image Restoration by Residual Shiftingcited by 64
- 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 63
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2019Attention-aware Multi-stroke Style Transfercited by 47
- 2020Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenescited by 43
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.