Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videos
Not on the map. Why?
Abstract (arXiv)
Photorealistic talking-head avatars are becoming increasingly common in virtual meetings, gaming, and social platforms. These avatars allow for more immersive communication, but they also introduce serious security risks. One emerging threat is impersonation: an attacker can steal a user's avatar, preserving his appearance and voice, making it nearly impossible to detect its fraudulent usage by sight or sound alone. In this paper, we explore the challenge of biometric verification in such avatar-mediated scenarios. Our main question is whether an individual's facial motion patterns can serve as reliable behavioral biometrics to verify their identity when the avatar's visual appearance is a facsimile of its owner. To answer this question, we introduce a new dataset of realistic avatar videos created using a state-of-the-art one-shot avatar generation model, GAGAvatar, with genuine and impostor avatar videos. We also propose a lightweight, explainable spatio-temporal Graph Convolutional Network architecture with temporal attention pooling, that uses only facial landmarks to model dynamic facial gestures. Experimental results demonstrate that facial motion cues enable meaningful identity verification with AUC values approaching 80%. The proposed benchmark and biometric system are available for the research community in order to bring attention to the urgent need for more advanced behavioral biometric defenses in avatar-based communication systems.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
24 of 38 references.
References · 24
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
- 2020Media Forensics and DeepFakes: an overviewcited by 209
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 73
- 2024How Good is ChatGPT at Face Biometrics? A First Look into Recognition, Soft Biometrics, and Explainabilitycited by 34
- 2023Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitmentcited by 33
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
- 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
- 2022Exploring Transformers for Behavioural Biometrics: A Case Study in Gait Recognitioncited by 13
- 2020BeCAPTCHA-Mouse: Synthetic Mouse Trajectories and Improved Bot Detectioncited by 12
- 2024A multimodal dataset for understanding the impact of mobile phones on remote online virtual educationcited by 12
12 more
- 2020Facial Expressions as a Vulnerability in Face Recognitioncited by 11
- 2021SetMargin Loss applied to Deep Keystroke Biometrics with Circle Packing Interpretationcited by 11
- 2021Introduction to Presentation Attack Detection in Face Biometrics and Recent Advancescited by 11
- 2023Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videoscited by 11
- 2024Biometrics and Behavior Analysis for Detecting Distractions in e-Learningcited by 10
- 2023Deepfake in the Metaverse: Security Implications for Virtual Gaming, Meetings, and Officescited by 8
- 2020BeCAPTCHA: Detecting Human Behavior in Smartphone Interaction using Multiple Inbuilt Sensorscited by 7
- 2025SelfMAD: Enhancing Generalization and Robustness in Morphing Attack Detection via Self-Supervised Learningcited by 7
- 2025Benchmarking Graph Neural Networks for Document Layout Analysis in Public Affairscited by 7
- 2024Type2Branch: Keystroke Biometrics based on a Dual-branch Architecture with Attention Mechanisms and Set2set Losscited by 5
- 2024From Pixels to Words: Leveraging Explainability in Face Recognition through Interactive Natural Language Processingcited by 5
- 2025Comparison of Visual Trackers for Biomechanical Analysis of Runningcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2026Leveraging Avatar Fingerprinting: A Multi-Generator Photorealistic Talking-Head Public Database and Benchmarkcited by 2
- 2025Is Visual Realism Enough? Evaluating Gait Biometric Fidelity in Generative AI Human Animationcited by 1
- 2026Micro-Expression-Aware Avatar Fingerprinting via Inter-Frame Feature Differencingcited by 0
- 2026Micro-Expression-Aware Avatar Fingerprinting via Inter-Frame Feature Differencing25 Apr 2026
- 2026Leveraging Avatar Fingerprinting: A Multi-Generator Photorealistic Talking-Head Public Database and Benchmark27 Mar 2026
- 2025Is Visual Realism Enough? Evaluating Gait Biometric Fidelity in Generative AI Human Animation22 Dec 2025