mlsanityData to 7 Oct 2026

Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges

arXiv 2305.14080 ↗First posted 23 May 2023cs.HC cs.AI cs.CRcited by 12

Not on the map. Why?

Abstract (arXiv)

The latest developments in computer hardware, sensor technologies, and artificial intelligence can make virtual reality (VR) and virtual spaces an important part of human everyday life. Eye tracking offers not only a hands-free way of interaction but also the possibility of a deeper understanding of human visual attention and cognitive processes in VR. Despite these possibilities, eye-tracking data also reveals users' privacy-sensitive attributes when combined with the information about the presented stimulus. To address all, this survey first covers major works in eye tracking, VR, and privacy areas between 2012 and 2022. While eye tracking in VR part covers the computational eye tracking pipeline from pupil detection and gaze estimation to offline data analysis, for privacy and security, we focus on eye-based authentication as well as computational methods to preserve the privacy of individuals and their eye-tracking data in VR. Later, we outline three main directions by focusing on privacy. In summary, this survey presents an extensive literature review of the utmost possibilities of eye tracking in VR and their privacy implications.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 72 of its 395 references that are in the map. First posted on arXiv 23 May 2023.

Builds on

72 of 395 references.

References · 72

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  4. 2016Densely Connected Convolutional Networkscited by 6,691
  5. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  6. 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
  7. 2015A Neural Algorithm of Artistic Stylecited by 480
  8. 2016Eye Tracking for Everyonecited by 155
  9. 2015Appearance-Based Gaze Estimation in the Wildcited by 153
  10. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  11. 2017MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimationcited by 118
  12. 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
38 more
  1. 2016Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Modelcited by 91
  2. 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
  3. 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
  4. 2020Event Based, Near Eye Gaze Tracking Beyond 10,000Hzcited by 53
  5. 2015Rendering of Eyes for Eye-Shape Registration and Gaze Estimationcited by 49
  6. 2018Deep Pictorial Gaze Estimationcited by 49
  7. 2014Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interactioncited by 43
  8. 2019Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesiscited by 43
  9. 2019Unsupervised Representation Learning for Gaze Estimationcited by 42
  10. 2022A Full Dive into Realizing the Edge-enabled Metaverse: Visions, Enabling Technologies,and Challengescited by 39
  11. 2018Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settingscited by 38
  12. 2019RITnet: Real-time Semantic Segmentation of the Eye for Gaze Trackingcited by 33
  13. 2018PathGAN: Visual Scanpath Prediction with Generative Adversarial Networkscited by 32
  14. 2021TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Typescited by 32
  15. 2017SaltiNet: Scan-path Prediction on 360 Degree Images using Saliency Volumescited by 29
  16. 2019Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applicationscited by 29
  17. 2019OpenEDS: Open Eye Datasetcited by 27
  18. 2022Deep Learning for Iris Recognition: A Surveycited by 25
  19. 2020EllSeg: An Ellipse Segmentation Framework for Robust Gaze Trackingcited by 24
  20. 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Imagescited by 23
  21. 2022Real-Time Gaze Tracking with Event-Driven Eye Segmentationcited by 21
  22. 2019Gaze-Contingent Ocular Parallax Rendering for Virtual Realitycited by 20
  23. 2017A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platformscited by 19
  24. 2018Light-weight Head Pose Invariant Gaze Trackingcited by 14
  25. 2021A privacy-preserving approach to streaming eye-tracking datacited by 13
  26. 2018Privacy-Aware Eye Tracking Using Differential Privacycited by 11
  27. 2020Differential Privacy for Eye Tracking with Temporal Correlationscited by 11
  28. 2019Differential Privacy for Eye-Tracking Datacited by 9
  29. 2021Digital Transformations of Classrooms in Virtual Realitycited by 9
  30. 2019Eyenet: Attention based Convolutional Encoder-Decoder Network for Eye Region Segmentationcited by 7
  31. 2019Content-Consistent Generation of Realistic Eyes with Stylecited by 7
  32. 2019Privacy Preserving Gaze Estimation using Synthetic Images via a Randomized Encoding Based Frameworkcited by 7
  33. 2022Color-Perception-Guided Display Power Reduction for Virtual Realitycited by 7
  34. 2022Federated Learning for Appearance-based Gaze Estimation in the Wildcited by 7
  35. 2019A Ground-Truth Data Set and a Classification Algorithm for Eye Movements in 360-degree Videoscited by 6
  36. 2019Biometric Performance as a Function of Gallery Sizecited by 6
  37. 2019Evaluating the Data Quality of Eye Tracking Signals from a Virtual Reality System: Case Study using SMI's Eye-Tracking HTC Vivecited by 6
  38. 2023SoK: Data Privacy in Virtual Realitycited by 6

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 7; 2026: 1.

12 papers.

  1. 2024Embedding Large Language Models into Extended Reality: Opportunities and Challenges for Inclusion, Engagement, and Privacycited by 14
  2. 2024PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computationcited by 3
  3. 2025Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systemscited by 2
  4. 2024VRBiom: A New Periocular Dataset for Biometric Applications of HMDcited by 1
  5. 2024Biometrics in Extended Reality: A Reviewcited by 1
  6. 2025Trade-offs in Privacy-Preserving Eye Tracking through Iris Obfuscation: A Benchmarking Studycited by 1
  7. 2025Exploring Context-aware and LLM-driven Locomotion for Immersive Virtual Realitycited by 1
  8. 2025Examining the Role of LLM-Driven Interactions on Attention and Cognitive Engagement in Virtual Classroomscited by 1
  9. 2025QualitEye: Public and Privacy-preserving Gaze Data Quality Verificationcited by 1
  10. 2025FairDeFace: Evaluating the Fairness and Adversarial Robustness of Face Obfuscation Methodscited by 0
  11. 2025PrivateXR: Defending Privacy Attacks in Extended Reality Through Explainable AI-Guided Differential Privacycited by 0
  12. 2026Behavioral Engagement in VR-Based Sign Language Learning: Visual Attention as a Predictor of Performance and Temporal Dynamicscited by 0