# Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming

arXiv: https://arxiv.org/abs/2506.10004 · HTML: https://mlsanity.com/paper/2506.10004/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 24 of its 145 references that are in the map.
- First posted on arXiv 27 Mar 2025.

## Builds on (most cited first, 24 of 24)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Asynchronous Methods for Deep Reinforcement Learning](https://mlsanity.com/paper/1602.01783/) (2016)
- [Perceptual Video Quality Assessment: A Survey](https://mlsanity.com/paper/2402.03413/) (2024)
- [Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning Approach](https://mlsanity.com/paper/1710.10755/) (2017)
- [Perceptual Quality Assessment of Omnidirectional Images](https://mlsanity.com/paper/2207.02674/) (2022)
- [Confusing Image Quality Assessment: Towards Better Augmented Reality Experience](https://mlsanity.com/paper/2204.04900/) (2022)
- [AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images](https://mlsanity.com/paper/2404.01024/) (2024)
- [Hand tracking for immersive virtual reality: opportunities and challenges](https://mlsanity.com/paper/2103.14853/) (2021)
- [Audio-visual Saliency for Omnidirectional Videos](https://mlsanity.com/paper/2311.05190/) (2023)
- [ESIQA: Perceptual Quality Assessment of Vision-Pro-based Egocentric Spatial Images](https://mlsanity.com/paper/2407.21363/) (2024)
- [A Survey on 360-Degree Video: Coding, Quality of Experience and Streaming](https://mlsanity.com/paper/2102.08192/) (2021)
- [How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Model](https://mlsanity.com/paper/2408.05411/) (2024)
- [Multi-Path Cooperative Communications Networks for Augmented and Virtual Reality Transmission](https://mlsanity.com/paper/1710.11486/) (2017)
- [Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network](https://mlsanity.com/paper/2009.13737/) (2020)
- [Interacting with New York City Data by HoloLens through Remote Rendering](https://mlsanity.com/paper/2212.10295/) (2022)
- [The Metaverse from a Multimedia Communications Perspective](https://mlsanity.com/paper/2301.07740/) (2023)
- [Human-Centric Resource Allocation for the Metaverse With Multiaccess Edge Computing](https://mlsanity.com/paper/2312.15313/) (2023)
- [Universal Packet Scheduling](https://mlsanity.com/paper/1510.03551/) (2015)
- [An Open Framework for Analyzing and Modeling XR Network Traffic](https://mlsanity.com/paper/2108.04577/) (2021)
- [Towards a QoE Model to Evaluate Holographic Augmented Reality Devices](https://mlsanity.com/paper/2212.13842/) (2022)
- [Evolution of 3GPP Standards Towards True Extended Reality (XR) Support in 6G Networks](https://mlsanity.com/paper/2306.04012/) (2023)
- [Immersive Experiences and XR: A Game Engine or Multimedia Streaming Problem?](https://mlsanity.com/paper/2201.05552/) (2022)
- [Improving Content-Aware Video Streaming in Congested Networks with In-Network Computing](https://mlsanity.com/paper/2202.04703/) (2022)
- [Technical Evaluation of HoloLens for Multimedia: A First Look](https://mlsanity.com/paper/2212.12907/) (2022)

## Abstract (arXiv)

Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption. In XR, users integrate various sensory inputs to form a cohesive perception of the virtual environment. This survey reviews the state-of-the-art in XR streaming, focusing on multiple paradigms. To begin, we define XR and introduce various XR headsets along with their multimodal interaction methods to provide a foundational understanding. We then analyze XR traffic characteristics to highlight the unique data transmission requirements. We also explore factors that influence the quality of experience in XR systems, aiming to identify key elements for enhancing user satisfaction. Following this, we present visual attention-based optimization methods for XR streaming to improve efficiency and performance. Finally, we examine current applications and highlight challenges to provide insights into ongoing and future developments of XR.
