mlsanityData to 7 Oct 2026

Using Motion Forecasting for Behavior-Based Virtual Reality (VR) Authentication

arXiv 2401.16649 ↗First posted 30 Jan 2024cs.LG cs.CRcited by 1

Not on the map. Why?

Abstract (arXiv)

Task-based behavioral biometric authentication of users interacting in virtual reality (VR) environments enables seamless continuous authentication by using only the motion trajectories of the person's body as a unique signature. Deep learning-based approaches for behavioral biometrics show high accuracy when using complete or near complete portions of the user trajectory, but show lower performance when using smaller segments from the start of the task. Thus, any systems designed with existing techniques are vulnerable while waiting for future segments of motion trajectories to become available. In this work, we present the first approach that predicts future user behavior using Transformer-based forecasting and using the forecasted trajectory to perform user authentication. Our work leverages the notion that given the current trajectory of a user in a task-based environment we can predict the future trajectory of the user as they are unlikely to dramatically shift their behavior since it would preclude the user from successfully completing their task goal. Using the publicly available 41-subject ball throwing dataset of Miller et al. we show improvement in user authentication when using forecasted data. When compared to no forecasting, our approach reduces the authentication equal error rate (EER) by an average of 23.85% and a maximum reduction of 36.14%.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 61 references that are in the map. First posted on arXiv 30 Jan 2024.

Builds on

16 of 61 references.

References · 16

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2016Layer Normalizationcited by 5,579
  7. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  8. 2013Network In Networkcited by 600
  9. 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 358
  10. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  11. 2018Human Action Recognition and Prediction: A Surveycited by 226
  12. 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
4 more
  1. 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
  2. 2021Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Drivingcited by 73
  3. 2023Who Is Alyx? A new Behavioral Biometric Dataset for User Identification in XRcited by 7
  4. 2022Security and Privacy in Virtual Reality: A Literature Surveycited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.