AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trends
Not on the map. Why?
Abstract (arXiv)
Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role of AI, 6G, and the nexus of both in realizing the immersive experiences of Metaverse. Therefore, in this survey, we first introduce the background and ongoing progress in augmented reality (AR), virtual reality (VR), mixed reality (MR) and spatial computing, followed by the technical aspects of AI and 6G. Then, we survey the role of AI in the Metaverse by reviewing the state-of-the-art in deep learning, computer vision, and Edge AI to extract the requirements of 6G in Metaverse. Next, we investigate the promising services of B5G/6G towards Metaverse, followed by identifying the role of AI in 6G networks and 6G networks for AI in support of Metaverse applications, and the need for sustainability in Metaverse. Finally, we enlist the existing and potential applications, usecases, and projects to highlight the importance of progress in the Metaverse. Moreover, in order to provide potential research directions to researchers, we underline the challenges, research gaps, and lessons learned identified from the literature review of the aforementioned technologies.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 82 of its 322 references that are in the map. First posted on arXiv 23 Aug 2022.
Builds on
82 of 322 references.
References · 82
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
38 more
- 2020Self-supervised Learning: Generative or Contrastivecited by 693
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2019Panoptic Feature Pyramid Networkscited by 644
- 2016RMPE: Regional Multi-person Pose Estimationcited by 340
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2018An Introduction to Deep Reinforcement Learningcited by 201
- 2019A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problemscited by 157
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 2020Semantic Flow for Fast and Accurate Scene Parsingcited by 128
- 2019Convergence of Edge Computing and Deep Learning: A Comprehensive Surveycited by 120
- 2017Exploiting temporal information for 3D pose estimationcited by 89
- 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
- 2021TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Modelscited by 74
- 2021All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agendacited by 67
- 2020A survey on Semi-, Self- and Unsupervised Learning for Image Classificationcited by 55
- 2022A Survey on Metaverse: Fundamentals, Security, and Privacycited by 51
- 20196G Wireless Communication Systems: Applications, Requirements, Technologies, Challenges, and Research Directionscited by 34
- 2022Lawin Transformer: Improving Semantic Segmentation Transformer with Multi-Scale Representations via Large Window Attentioncited by 30
- 2022Artificial Intelligence for the Metaverse: A Surveycited by 25
- 2021Metaverse for Social Good: A University Campus Prototypecited by 17
- 2022Realizing the Metaverse with Edge Intelligence: A Match Made in Heavencited by 17
- 2022Fusing Blockchain and AI with Metaverse: A Surveycited by 17
- 2022Blockchain-based Federated Learning for Industrial Metaverses: Incentive Scheme with Optimal AoIcited by 16
- 2022Attention-aware Resource Allocation and QoE Analysis for Metaverse xURLLC Servicescited by 15
- 2022Will Metaverse be NextG Internet? Vision, Hype, and Realitycited by 14
- 2022Blockchain for the Metaverse: A Reviewcited by 14
- 20226G-enabled Edge AI for Metaverse: Challenges, Methods, and Future Research Directionscited by 13
- 2021Wireless Edge-Empowered Metaverse: A Learning-Based Incentive Mechanism for Virtual Realitycited by 12
- 2021When Creators Meet the Metaverse: A Survey on Computational Artscited by 12
- 2021A Dynamic Resource Allocation Framework for Synchronizing Metaverse with IoT Service and Datacited by 11
- 2022MetaAID: A Flexible Framework for Developing Metaverse Applications via AI Technology and Human Editingcited by 11
- 2020Deep Learning for Ultra-Reliable and Low-Latency Communications in 6G Networkscited by 10
- 2017Interaction Methods for Smart Glassescited by 9
- 2020Cellular-Connected Wireless Virtual Reality: Requirements, Challenges, and Solutionscited by 7
- 2020Extreme URLLC: Vision, Challenges, and Key Enablerscited by 7
- 2021Data Augmentation for Graph Convolutional Network on Semi-Supervised Classificationcited by 7
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT datacited by 7
- 2022Towards Energy Efficient Distributed Federated Learning for 6G Networkscited by 7
50 most cited of 82 All 82 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 1; 2026: 1.
8 papers.
- 2023ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Reviewcited by 28
- 2023The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directionscited by 3
- 2025When Generative Artificial Intelligence meets Extended Reality: A Systematic Reviewcited by 1
- 2023FISTNet: FusIon of STyle-path generative Networks for Facial Style Transfercited by 0
- 2024Trading Devil Final: Backdoor attack via Stock market and Bayesian Optimizationcited by 0
- 2024Hyperdimensional Computing Empowered Federated Foundation Model over Wireless Networks for Metaversecited by 0
- 2024Trading Devil RL: Backdoor attack via Stock market, Bayesian Optimization and Reinforcement Learningcited by 0
- 2026Equitable Multi-Task Learning for AI-RANscited by 0
- 2026Equitable Multi-Task Learning for AI-RANs9 Feb 2026
- 2025When Generative Artificial Intelligence meets Extended Reality: A Systematic Review5 Nov 2025
- 2024Trading Devil RL: Backdoor attack via Stock market, Bayesian Optimization and Reinforcement Learning23 Dec 2024
- 2024Hyperdimensional Computing Empowered Federated Foundation Model over Wireless Networks for Metaverse26 Aug 2024
- 2024Trading Devil Final: Backdoor attack via Stock market and Bayesian Optimization21 Jul 2024
- 2023FISTNet: FusIon of STyle-path generative Networks for Facial Style Transfer18 Jul 2023
- 2023The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions18 Apr 2023
- 2023ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review13 Apr 2023