Multimodality in VR: A survey
Not on the map. Why?
Abstract (arXiv)
Virtual reality (VR) is rapidly growing, with the potential to change the way we create and consume content. In VR, users integrate multimodal sensory information they receive, to create a unified perception of the virtual world. In this survey, we review the body of work addressing multimodality in VR, and its role and benefits in user experience, together with different applications that leverage multimodality in many disciplines. These works thus encompass several fields of research, and demonstrate that multimodality plays a fundamental role in VR; enhancing the experience, improving overall performance, and yielding unprecedented abilities in skill and knowledge transfer.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jan 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 2; 2024: 2; 2025: 1.
6 papers.
- 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Imagescited by 23
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
- 2025MoE3D: Mixture of Experts meets Multi-Modal 3D Understandingcited by 6
- 2023RegBN: Batch Normalization of Multimodal Data with Regularizationcited by 5
- 2024Robust Active Speaker Detection in Noisy Environmentscited by 2
- 2024ESP-PCT: Enhanced VR Semantic Performance through Efficient Compression of Temporal and Spatial Redundancies in Point Cloud Transformerscited by 2
- 2025MoE3D: Mixture of Experts meets Multi-Modal 3D Understanding27 Nov 2025
- 2024ESP-PCT: Enhanced VR Semantic Performance through Efficient Compression of Temporal and Spatial Redundancies in Point Cloud Transformers2 Sep 2024
- 2024Robust Active Speaker Detection in Noisy Environments27 Mar 2024
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape18 Dec 2023
- 2023RegBN: Batch Normalization of Multimodal Data with Regularization1 Oct 2023
- 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Images25 Mar 2021