mlsanityData to 7 Oct 2026

AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trends

arXiv 2208.10921 ↗First posted 23 Aug 2022cs.AI cs.HC cs.NIcited by 8

Not on the map. Why?

Abstract (arXiv)

Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role of AI, 6G, and the nexus of both in realizing the immersive experiences of Metaverse. Therefore, in this survey, we first introduce the background and ongoing progress in augmented reality (AR), virtual reality (VR), mixed reality (MR) and spatial computing, followed by the technical aspects of AI and 6G. Then, we survey the role of AI in the Metaverse by reviewing the state-of-the-art in deep learning, computer vision, and Edge AI to extract the requirements of 6G in Metaverse. Next, we investigate the promising services of B5G/6G towards Metaverse, followed by identifying the role of AI in 6G networks and 6G networks for AI in support of Metaverse applications, and the need for sustainability in Metaverse. Finally, we enlist the existing and potential applications, usecases, and projects to highlight the importance of progress in the Metaverse. Moreover, in order to provide potential research directions to researchers, we underline the challenges, research gaps, and lessons learned identified from the literature review of the aforementioned technologies.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 82 of its 322 references that are in the map. First posted on arXiv 23 Aug 2022.

Builds on

82 of 322 references.

References · 82

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  9. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  10. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  11. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  12. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
38 more
  1. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  2. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  3. 2019Panoptic Feature Pyramid Networkscited by 644
  4. 2016RMPE: Regional Multi-person Pose Estimationcited by 340
  5. 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
  6. 2018An Introduction to Deep Reinforcement Learningcited by 201
  7. 2019A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problemscited by 157
  8. 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
  9. 2020Semantic Flow for Fast and Accurate Scene Parsingcited by 128
  10. 2019Convergence of Edge Computing and Deep Learning: A Comprehensive Surveycited by 120
  11. 2017Exploiting temporal information for 3D pose estimationcited by 89
  12. 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
  13. 2021TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Modelscited by 74
  14. 2021All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agendacited by 67
  15. 2020A survey on Semi-, Self- and Unsupervised Learning for Image Classificationcited by 55
  16. 2022A Survey on Metaverse: Fundamentals, Security, and Privacycited by 51
  17. 20196G Wireless Communication Systems: Applications, Requirements, Technologies, Challenges, and Research Directionscited by 34
  18. 2022Lawin Transformer: Improving Semantic Segmentation Transformer with Multi-Scale Representations via Large Window Attentioncited by 30
  19. 2022Artificial Intelligence for the Metaverse: A Surveycited by 25
  20. 2021Metaverse for Social Good: A University Campus Prototypecited by 17
  21. 2022Realizing the Metaverse with Edge Intelligence: A Match Made in Heavencited by 17
  22. 2022Fusing Blockchain and AI with Metaverse: A Surveycited by 17
  23. 2022Blockchain-based Federated Learning for Industrial Metaverses: Incentive Scheme with Optimal AoIcited by 16
  24. 2022Attention-aware Resource Allocation and QoE Analysis for Metaverse xURLLC Servicescited by 15
  25. 2022Will Metaverse be NextG Internet? Vision, Hype, and Realitycited by 14
  26. 2022Blockchain for the Metaverse: A Reviewcited by 14
  27. 20226G-enabled Edge AI for Metaverse: Challenges, Methods, and Future Research Directionscited by 13
  28. 2021Wireless Edge-Empowered Metaverse: A Learning-Based Incentive Mechanism for Virtual Realitycited by 12
  29. 2021When Creators Meet the Metaverse: A Survey on Computational Artscited by 12
  30. 2021A Dynamic Resource Allocation Framework for Synchronizing Metaverse with IoT Service and Datacited by 11
  31. 2022MetaAID: A Flexible Framework for Developing Metaverse Applications via AI Technology and Human Editingcited by 11
  32. 2020Deep Learning for Ultra-Reliable and Low-Latency Communications in 6G Networkscited by 10
  33. 2017Interaction Methods for Smart Glassescited by 9
  34. 2020Cellular-Connected Wireless Virtual Reality: Requirements, Challenges, and Solutionscited by 7
  35. 2020Extreme URLLC: Vision, Challenges, and Key Enablerscited by 7
  36. 2021Data Augmentation for Graph Convolutional Network on Semi-Supervised Classificationcited by 7
  37. 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT datacited by 7
  38. 2022Towards Energy Efficient Distributed Federated Learning for 6G Networkscited by 7

50 most cited of 82 All 82 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 3; 2025: 1; 2026: 1.

8 papers.