# MetaAID: A Flexible Framework for Developing Metaverse Applications via AI Technology and Human Editing

arXiv: https://arxiv.org/abs/2204.01614 · HTML: https://mlsanity.com/paper/2204.01614/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 33 references that are in the map.
- First posted on arXiv 4 Apr 2022.

## Builds on (most cited first, 13 of 13)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [You Only Look Once: Unified, Real-Time Object Detection](https://mlsanity.com/paper/1506.02640/) (2015)
- [Self-supervised Learning: Generative or Contrastive](https://mlsanity.com/paper/2006.08218/) (2020)
- [Caffe: Convolutional Architecture for Fast Feature Embedding](https://mlsanity.com/paper/1408.5093/) (2014)
- [An Introduction to Deep Reinforcement Learning](https://mlsanity.com/paper/1811.12560/) (2018)
- [Scalable Zero-shot Entity Linking with Dense Entity Retrieval](https://mlsanity.com/paper/1911.03814/) (2019)
- [Digital Twin: Values, Challenges and Enablers](https://mlsanity.com/paper/1910.01719/) (2019)
- [UER: An Open-Source Toolkit for Pre-training Models](https://mlsanity.com/paper/1909.05658/) (2019)
- [Artificial Intelligence for the Metaverse: A Survey](https://mlsanity.com/paper/2202.10336/) (2022)
- [MetaOnce: A Metaverse Framework Based on Multi-scene Relations and Entity-relation-event Game](https://mlsanity.com/paper/2203.10424/) (2022)

## Built on by (most cited first, 11 of 11)

- [AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trends](https://mlsanity.com/paper/2208.10921/) (2022)
- [Climate Change from Large Language Models](https://mlsanity.com/paper/2312.11985/) (2023)
- [Financial data analysis application via multi-strategy text processing](https://mlsanity.com/paper/2204.11394/) (2022)
- [MetaAID 2.0: An Extensible Framework for Developing Metaverse Applications via Human-controllable Pre-trained Models](https://mlsanity.com/paper/2302.13173/) (2023)
- [Federated Learning for Metaverse: A Survey](https://mlsanity.com/paper/2303.17987/) (2023)
- [The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions](https://mlsanity.com/paper/2304.09240/) (2023)
- [Privacy Preservation in Artificial Intelligence and Extended Reality (AI-XR) Metaverses: A Survey](https://mlsanity.com/paper/2310.10665/) (2023)
- [MetaAID 2.5: A Secure Framework for Developing Metaverse Applications via Large Language Models](https://mlsanity.com/paper/2312.14480/) (2023)
- [Extracting Relational Triples Based on Graph Recursive Neural Network via Dynamic Feedback Forest Algorithm](https://mlsanity.com/paper/2308.11411/) (2023)
- [Reranking Passages with Coarse-to-Fine Neural Retriever Enhanced by List-Context Information](https://mlsanity.com/paper/2308.12022/) (2023)
- [Metaverse Survey & Tutorial: Exploring Key Requirements, Technologies, Standards, Applications, Challenges, and Perspectives](https://mlsanity.com/paper/2405.04718/) (2024)

## Abstract (arXiv)

Achieving the expansion of domestic demand and the economic internal circulation requires balanced and coordinated support from multiple industries (domains) such as consumption, education, entertainment, engineering infrastructure, etc., which is indispensable for maintaining economic development. Metaverse applications may help with this task and can make many industries more interesting, more efficient, and provide a better user experience. The first challenge is that metaverse application development inevitably requires the support of various artificial intelligence (AI) technologies such as natural language processing (NLP), knowledge graph (KG), computer vision (CV), and machine learning (ML), etc. However, existing metaverse application development lacks a lightweight AI technology framework. This paper proposes a flexible metaverse AI technology framework metaAID that aims to support language and semantic technologies in the development of digital twins and virtual humans. The second challenge is that the development process of metaverse applications involves both technical development tasks and manual editing work, and often becomes a heavyweight multi-team collaboration project, not to mention the development of metaverse applications in multiple industries. Our framework summarizes common AI technologies and application development templates with common functional modules and interfaces. Based on this framework, we have designed 5 applications for 3 industries around the expansion of domestic demand and economic internal circulation. Experimental results show that our framework can support AI technologies when developing metaverse applications in different industries.