mlsanityData to 14 Oct 2026

Unmasking Face Embeddings: Reading, Rendering and Naming with Foundation Models

arXiv 2609.00411 ↗First posted 31 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern face recognition (FR) owes much of its success to deep neural networks that learn to extract compact identity embeddings from face images. These models are typically trained for identity discrimination, producing embeddings that are highly effective for biometric matching but largely opaque to semantic interpretation. In contrast, foundation models, pretrained on broad visual or vision--language tasks, provide rich interfaces for describing, retrieving, generating, and organizing visual content. This contrast raises a natural question: what capabilities become available when face embeddings from domain-specific FR models are made interoperable with foundation models? Building on recent work on embedding compatibility across models, we use simple pre-computed linear transformations, estimated from paired embeddings alone, to connect existing FR models with off-the-shelf foundation models. Once aligned with a foundation model, a face embedding can be 'unmasked' in multiple ways, without training or modifying either model: it can be read in natural language, enabling free-form text queries over a gallery of FR embeddings; rendered into a face image that recovers a person's appearance, using an unmodified diffusion decoder; and converted to a name, enabling identification even in the absence of an enrolled face gallery. In effect, one linear transformation turns an identity embedding into a rich embedding for web-scale foundation models. This interoperability exposes face embeddings as semantically and visually rich biometric representations, with direct implications for interpretability, retrieval, reconstruction, and template security.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

34 of 42 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  9. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
  10. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 624
  11. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  12. 2017Age Progression/Regression by Conditional Adversarial Autoencodercited by 429
22 more
  1. 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
  2. 2024The Platonic Representation Hypothesiscited by 382
  3. 2021MagFace: A Universal Representation for Face Recognition and Quality Assessmentcited by 334
  4. 2023Demystifying CLIP Datacited by 270
  5. 2014Understanding image representations by measuring their equivariance and equivalencecited by 243
  6. 2021WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognitioncited by 223
  7. 2021Revisiting Model Stitching to Compare Neural Representationscited by 209
  8. 2022Relative representations enable zero-shot latent space communicationcited by 191
  9. 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
  10. 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
  11. 2017On the Reconstruction of Face Images from Deep Face Templatescited by 67
  12. 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 38
  13. 2020Beyond Identity: What Information Is Stored in Biometric Face Templates?cited by 23
  14. 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusioncited by 22
  15. 2022Does CLIP Know My Face?cited by 19
  16. 202550 Years of Automated Face Recognitioncited by 15
  17. 202415M Multimodal Facial Image-Text Datasetcited by 14
  18. 2025Benchmarking Foundation Models for Zero-Shot Biometric Taskscited by 14
  19. 2024Face Reconstruction from Face Embeddings using Adapter to a Face Foundation Modelcited by 9
  20. 2025Foundation versus Domain-specific Models: Performance Comparison, Fusion, and Explainability in Face Recognitioncited by 8
  21. 2025Deep CNN Face Matchers Inherently Support Revocable Biometric Templatescited by 3
  22. 2026Compatibility of Face Embeddings Across Deep Neural Networkscited by 1

Built on by

Not cited yet.