mlsanityData to 7 Oct 2026

Text2Face: A Multi-Modal 3D Face Model

arXiv 2303.02688 ↗First posted 5 Mar 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

We present the first 3D morphable modelling approach, whereby 3D face shape can be directly and completely defined using a textual prompt. Building on work in multi-modal learning, we extend the FLAME head model to a common image-and-text latent space. This allows for direct 3D Morphable Model (3DMM) parameter generation and therefore shape manipulation from textual descriptions. Our method, Text2Face, has many applications; for example: generating police photofits where the input is already in natural language. It further enables multi-modal 3DMM image fitting to sketches and sculptures, as well as images.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 5 Mar 2023.

Builds on

10 of 17 references.

References · 10

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  6. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  7. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  8. 2018Deep Appearance Models for Face Renderingcited by 164
  9. 2021Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implicationscited by 128
  10. 2022ClipFace: Text-guided Editing of Textured 3D Morphable Modelscited by 59

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.

  1. 2024UltrAvatar: A Realistic Animatable 3D Avatar Diffusion Model with Authenticity Guided Texturescited by 13
  2. 2024Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularizationcited by 8
  3. 2026Dual Diffusion Models for Multi-modal Guided 3D Avatar Generationcited by 0