Towards Consumer-Grade Cybersickness Prediction: Multi-Model Alignment for Real-Time Vision-Only Inference
Not on the map. Why?
Abstract (arXiv)
Cybersickness remains a major obstacle to the widespread adoption of immersive virtual reality (VR), particularly in consumer-grade environments. While prior methods rely on invasive signals such as electroencephalography (EEG) for high predictive accuracy, these approaches require specialized hardware and are impractical for real-world applications. In this work, we propose a scalable, deployable framework for personalized cybersickness prediction leveraging only non-invasive signals readily available from commercial VR headsets, including head motion, eye tracking, and physiological responses. Our model employs a modality-specific graph neural network enhanced with a Difference Attention Module to extract temporal-spatial embeddings capturing dynamic changes across modalities. A cross-modal alignment module jointly trains the video encoder to learn personalized traits by aligning video features with sensor-derived representations. Consequently, the model accurately predicts individual cybersickness using only video input during inference. Experimental results show our model achieves 88.4% accuracy, closely matching EEG-based approaches (89.16%), while reducing deployment complexity. With an average inference latency of 90ms, our framework supports real-time applications, ideal for integration into consumer-grade VR platforms without compromising personalization or performance. The code will be relesed at https://github.com/U235-Aurora/PTGNN.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 1 of its 13 references that are in the map. First posted on arXiv 2 Jan 2025.
Builds on
1 of 13 references.
References · 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025VideoASMR-Bench: Can AI-Generated ASMR Videos Fool VLMs and Humans?
- 2026Toward Postural State Classification in Immersive VR with Multimodal Data and Explainability Analysis
- 2026Deep Learning for Virtual Reality User Identification: A Benchmark
- 2026Do Models See in Line with Human Vision? Probing the Correspondence Between LVLM Representations and EEG Signals
- 2025Audio-Visual World Models: Learning Physically Grounded Multisensory Dynamics
- 2025Audio Driven Real-Time Facial Animation for Social Telepresence
- 2024The Curse of Multi-Modalities: Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
- 2025Scene2Hap: Generating Scene-Wide Haptics for VR from Scene Context with Multimodal LLMs ↗