mlsanityData to 14 Oct 2026

User-centric Heterogeneous-action Deep Reinforcement Learning for Virtual Reality in the Metaverse over Wireless Networks

arXiv 2302.01471 ↗First posted 3 Feb 2023cs.NI cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

The Metaverse is emerging as maturing technologies are empowering the different facets. Virtual Reality (VR) technologies serve as the backbone of the virtual universe within the Metaverse to offer a highly immersive user experience. As mobility is emphasized in the Metaverse context, VR devices reduce their weights at the sacrifice of local computation abilities. In this paper, for a system consisting of a Metaverse server and multiple VR users, we consider two cases of (i) the server generating frames and transmitting them to users, and (ii) users generating frames locally and thus consuming device energy. Moreover, in our multi-user VR scenario for the Metaverse, users have different characteristics and demands for Frames Per Second (FPS). Then the channel access arrangement (including the decisions on frame generation location), and transmission powers for the downlink communications from the server to the users are jointly optimized to improve the utilities of users. This joint optimization is addressed by deep reinforcement learning (DRL) with heterogeneous actions. Our proposed user-centric DRL algorithm is called User-centric Critic with Heterogenous Actors (UCHA). Extensive experiments demonstrate that our UCHA algorithm leads to remarkable results under various requirements and constraints.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 47 references that are in the map. First posted on arXiv 3 Feb 2023.

Builds on

17 of 47 references.

References · 17

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2015Trust Region Policy Optimizationcited by 2,580
  4. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  5. 2018Is Q-learning Provably Efficient?cited by 487
  6. 2019Convergence of Edge Computing and Deep Learning: A Comprehensive Surveycited by 120
  7. 2021All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agendacited by 67
  8. 2017Hybrid Reward Architecture for Reinforcement Learningcited by 58
  9. 2017Deep Learning for Video Game Playingcited by 30
  10. 2020When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multi-Timescale Resource Management for Multi-access Edge Computing in 5G Ultra Dense Networkcited by 30
  11. 2021Survey of Recent Multi-Agent Reinforcement Learning Algorithms Utilizing Centralized Trainingcited by 16
  12. 2022Phasic Self-Imitative Reduction for Sparse-Reward Goal-Conditioned Reinforcement Learningcited by 16
5 more
  1. 2018Handover Control in Wireless Systems via Asynchronous Multi-User Deep Reinforcement Learningcited by 9
  2. 2021Deep Reinforcement Learning with Spatio-temporal Traffic Forecasting for Data-Driven Base Station Sleep Controlcited by 7
  3. 2022Resource Allocation for Mobile Metaverse with the Internet of Vehicles over 6G Wireless Communications: A Deep Reinforcement Learning Approachcited by 6
  4. 2022Exploring Attention-Aware Network Resource Allocation for Customized Metaverse Servicescited by 5
  5. 2021Feeling of Presence Maximization: mmWave-Enabled Virtual Reality Meets Deep Reinforcement Learningcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

  1. 2024Statistical QoS Provision in Business-Centric Networkscited by 1