mlsanityData to 14 Oct 2026

Will You Be Aware? Eye Tracking-Based Modeling of Situational Awareness in Augmented Reality

arXiv 2508.05025 ↗First posted 7 Aug 2025cs.LG cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Augmented Reality (AR) systems, while enhancing task performance through real-time guidance, pose risks of inducing cognitive tunneling-a hyperfocus on virtual content that compromises situational awareness (SA) in safety-critical scenarios. This paper investigates SA in AR-guided cardiopulmonary resuscitation (CPR), where responders must balance effective compressions with vigilance to unpredictable hazards (e.g., patient vomiting). We developed an AR app on a Magic Leap 2 that overlays real-time CPR feedback (compression depth and rate) and conducted a user study with simulated unexpected incidents (e.g., bleeding) to evaluate SA, in which SA metrics were collected via observation and questionnaires administered during freeze-probe events. Eye tracking analysis revealed that higher SA levels were associated with greater saccadic amplitude and velocity, and with reduced proportion and frequency of fixations on virtual content. To predict SA, we propose FixGraphPool, a graph neural network that structures gaze events (fixations, saccades) into spatiotemporal graphs, effectively capturing dynamic attentional patterns. Our model achieved 83.0% accuracy (F1=81.0%), outperforming feature-based machine learning and state-of-the-art time-series models by leveraging domain knowledge and spatial-temporal information encoded in ET data. These findings demonstrate the potential of eye tracking for SA modeling in AR and highlight its utility in designing AR systems that ensure user safety and situational awareness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 89 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

11 of 89 references.

References · 11

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  3. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139
  4. 2019Edge Contraction Pooling for Graph Neural Networkscited by 53
  5. 2019Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoningcited by 40
  6. 2022GazeBaseVR, a large-scale, longitudinal, binocular eye-tracking dataset collected in virtual realitycited by 11
  7. 2019Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learningcited by 9
  8. 2024Real-Time Multimodal Cognitive Assistant for Emergency Medical Servicescited by 8
  9. 2025Reading Recognition in the Wildcited by 6
  10. 2024Exploring the Design Space of Optical See-through AR Head-Mounted Displays to Support First Responders in the Fieldcited by 2
  11. 2025Alignment Under Pressure: AR-HMD Support Tools for Action Teamscited by 1

Built on by

Not cited yet.