mlsanityData to 7 Oct 2026

Towards Consumer-Grade Cybersickness Prediction: Multi-Model Alignment for Real-Time Vision-Only Inference

arXiv 2501.01212 ↗First posted 2 Jan 2025cs.CV cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Cybersickness remains a major obstacle to the widespread adoption of immersive virtual reality (VR), particularly in consumer-grade environments. While prior methods rely on invasive signals such as electroencephalography (EEG) for high predictive accuracy, these approaches require specialized hardware and are impractical for real-world applications. In this work, we propose a scalable, deployable framework for personalized cybersickness prediction leveraging only non-invasive signals readily available from commercial VR headsets, including head motion, eye tracking, and physiological responses. Our model employs a modality-specific graph neural network enhanced with a Difference Attention Module to extract temporal-spatial embeddings capturing dynamic changes across modalities. A cross-modal alignment module jointly trains the video encoder to learn personalized traits by aligning video features with sensor-derived representations. Consequently, the model accurately predicts individual cybersickness using only video input during inference. Experimental results show our model achieves 88.4% accuracy, closely matching EEG-based approaches (89.16%), while reducing deployment complexity. With an average inference latency of 90ms, our framework supports real-time applications, ideal for integration into consumer-grade VR platforms without compromising personalization or performance. The code will be relesed at https://github.com/U235-Aurora/PTGNN.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 1 of its 13 references that are in the map. First posted on arXiv 2 Jan 2025.

Builds on

1 of 13 references.

References · 1

  1. 2024Hypergraph Multi-modal Large Language Model: Exploiting EEG and Eye-tracking Modalities to Evaluate Heterogeneous Responses for Video Understandingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025VideoASMR-Bench: Can AI-Generated ASMR Videos Fool VLMs and Humans?
  2. 2026Toward Postural State Classification in Immersive VR with Multimodal Data and Explainability Analysis
  3. 2026Deep Learning for Virtual Reality User Identification: A Benchmark
  4. 2026Do Models See in Line with Human Vision? Probing the Correspondence Between LVLM Representations and EEG Signals
  5. 2025Audio-Visual World Models: Learning Physically Grounded Multisensory Dynamics
  6. 2025Audio Driven Real-Time Facial Animation for Social Telepresence
  7. 2024The Curse of Multi-Modalities: Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  8. 2025Scene2Hap: Generating Scene-Wide Haptics for VR from Scene Context with Multimodal LLMs ↗