# Biometrics in Extended Reality: A Review

arXiv: https://arxiv.org/abs/2411.10489 · HTML: https://mlsanity.com/paper/2411.10489/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 32 of its 134 references that are in the map.
- First posted on arXiv 14 Nov 2024.

## Builds on (most cited first, 30 of 32)

- [Searching for MobileNetV3](https://mlsanity.com/paper/1905.02244/) (2019)
- [ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification](https://mlsanity.com/paper/2005.07143/) (2020)
- [PointAvatar: Deformable Point-based Head Avatars from Videos](https://mlsanity.com/paper/2212.08377/) (2022)
- [Deep Appearance Models for Face Rendering](https://mlsanity.com/paper/1808.00362/) (2018)
- [MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction](https://mlsanity.com/paper/1703.10580/) (2017)
- [Pixel Codec Avatars](https://mlsanity.com/paper/2104.04638/) (2021)
- [HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation](https://mlsanity.com/paper/2310.01406/) (2023)
- [QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatars](https://mlsanity.com/paper/2209.09391/) (2022)
- [SMPLpix: Neural Avatars from 3D Human Models](https://mlsanity.com/paper/2008.06872/) (2020)
- [FLAG: Flow-based 3D Avatar Generation from Sparse Observations](https://mlsanity.com/paper/2203.05789/) (2022)
- [AG3D: Learning to Generate 3D Avatars from 2D Image Collections](https://mlsanity.com/paper/2305.02312/) (2023)
- [Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement](https://mlsanity.com/paper/2106.11423/) (2021)
- [Presentation Attack Detection for Iris Recognition: An Assessment of the State of the Art](https://mlsanity.com/paper/1804.00194/) (2018)
- [Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments](https://mlsanity.com/paper/1511.05768/) (2015)
- [HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observations](https://mlsanity.com/paper/2308.11261/) (2023)
- [Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges](https://mlsanity.com/paper/2305.14080/) (2023)
- [GazeBaseVR, a large-scale, longitudinal, binocular eye-tracking dataset collected in virtual reality](https://mlsanity.com/paper/2210.07533/) (2022)
- [AgileAvatar: Stylized 3D Avatar Creation via Cascaded Domain Bridging](https://mlsanity.com/paper/2211.07818/) (2022)
- [Unsupervised Creation of Parameterized Avatars](https://mlsanity.com/paper/1704.05693/) (2017)
- [Security and Privacy Approaches in Mixed Reality: A Literature Survey](https://mlsanity.com/paper/1802.05797/) (2018)
- [Security and Privacy in Virtual Reality: A Literature Survey](https://mlsanity.com/paper/2205.00208/) (2022)
- [Photo-realistic 360 Head Avatars in the Wild](https://mlsanity.com/paper/2210.11594/) (2022)
- [Demonstrating Eye Movement Biometrics in Virtual Reality](https://mlsanity.com/paper/2207.02325/) (2022)
- [Security of Virtual Reality Authentication Methods in Metaverse: An Overview](https://mlsanity.com/paper/2209.06447/) (2022)
- [A Secure Authentication Framework to Guarantee the Traceability of Avatars in Metaverse](https://mlsanity.com/paper/2209.08893/) (2022)
- [SwiftAvatar: Efficient Auto-Creation of Parameterized Stylized Character on Arbitrary Avatar Engines](https://mlsanity.com/paper/2301.08153/) (2023)
- [Virtual Reality: Blessings and Risk Assessment](https://mlsanity.com/paper/1708.09540/) (2017)
- [FMHash: Deep Hashing of In-Air-Handwriting for User Identification](https://mlsanity.com/paper/1806.03574/) (2018)
- [A systematic literature review on Virtual Reality and Augmented Reality in terms of privacy, authorization and data-leaks](https://mlsanity.com/paper/2212.04621/) (2022)
- [MetaSecure: A Passwordless Authentication for the Metaverse](https://mlsanity.com/paper/2301.01770/) (2023)

## Built on by (most cited first, 1 of 1)

- [Ocular Verification for Virtual Reality](https://mlsanity.com/paper/2607.20790/) (2026)

## Abstract (arXiv)

In the domain of Extended Reality (XR), particularly Virtual Reality (VR), extensive research has been devoted to harnessing this transformative technology in various real-world applications. However, a critical challenge that must be addressed before unleashing the full potential of XR in practical scenarios is to ensure robust security and safeguard user privacy. This paper presents a systematic survey of the utility of biometric characteristics applied in the XR environment. To this end, we present a comprehensive overview of the different types of biometric modalities used for authentication and representation of users in a virtual environment. We discuss different biometric vulnerability gateways in general XR systems for the first time in the literature along with taxonomy. A comprehensive discussion on generating and authenticating biometric-based photorealistic avatars in XR environments is presented with a stringent taxonomy. We also discuss the availability of different datasets that are widely employed in evaluating biometric authentication in XR environments together with performance evaluation metrics. Finally, we discuss the open challenges and potential future work that need to be addressed in the field of biometrics in XR.