# When Creators Meet the Metaverse: A Survey on Computational Arts

arXiv: https://arxiv.org/abs/2111.13486 · HTML: https://mlsanity.com/paper/2111.13486/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 223 references that are in the map.
- First posted on arXiv 26 Nov 2021.

## Builds on (most cited first, 17 of 17)

- [WaveNet: A Generative Model for Raw Audio](https://mlsanity.com/paper/1609.03499/) (2016)
- [ScrabbleGAN: Semi-Supervised Varying Length Handwritten Text Generation](https://mlsanity.com/paper/2003.10557/) (2020)
- [GANwriting: Content-Conditioned Generation of Styled Handwritten Word Images](https://mlsanity.com/paper/2003.02567/) (2020)
- [Understanding and Creating Art with AI: Review and Outlook](https://mlsanity.com/paper/2102.09109/) (2021)
- [Real-time Localized Photorealistic Video Style Transfer](https://mlsanity.com/paper/2010.10056/) (2020)
- [Mapping the NFT revolution: market trends, trade networks and visual features](https://mlsanity.com/paper/2106.00647/) (2021)
- [ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach](https://mlsanity.com/paper/2108.03596/) (2021)
- [Metaverse for Social Good: A University Campus Prototype](https://mlsanity.com/paper/2108.08985/) (2021)
- [Single-Shot Freestyle Dance Reenactment](https://mlsanity.com/paper/2012.01158/) (2020)
- [An Iterative Polishing Framework based on Quality Aware Masked Language Model for Chinese Poetry Generation](https://mlsanity.com/paper/1911.13182/) (2019)
- [Compose Like Humans: Jointly Improving the Coherence and Novelty for Modern Chinese Poetry Generation](https://mlsanity.com/paper/2005.01556/) (2020)
- [Towards Augmented Reality-driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges](https://mlsanity.com/paper/2007.09207/) (2020)
- [A Multi-Modal Chinese Poetry Generation Model](https://mlsanity.com/paper/1806.09792/) (2018)
- [Crypto art: A decentralized view](https://mlsanity.com/paper/1906.03263/) (2019)
- [Making Robots Draw A Vivid Portrait In Two Minutes](https://mlsanity.com/paper/2005.05526/) (2020)
- [Under the Skin of Foundation NFT Auctions](https://mlsanity.com/paper/2109.12321/) (2021)
- [EdgeXAR: A 6-DoF Camera Multi-target Interaction Framework for MAR with User-friendly Latency Compensation](https://mlsanity.com/paper/2111.05173/) (2021)

## Built on by (most cited first, 12 of 12)

- [Music-Driven Group Choreography](https://mlsanity.com/paper/2303.12337/) (2023)
- [Controllable Group Choreography using Contrastive Diffusion](https://mlsanity.com/paper/2310.18986/) (2023)
- [Diffusion-Based Visual Art Creation: A Survey and New Perspectives](https://mlsanity.com/paper/2408.12128/) (2024)
- [Challenges and Remedies to Privacy and Security in AIGC: Exploring the Potential of Privacy Computing, Blockchain, and Beyond](https://mlsanity.com/paper/2306.00419/) (2023)
- [AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trends](https://mlsanity.com/paper/2208.10921/) (2022)
- [Scalable Group Choreography via Variational Phase Manifold Learning](https://mlsanity.com/paper/2407.18839/) (2024)
- [TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreography](https://mlsanity.com/paper/2506.18671/) (2025)
- [The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions](https://mlsanity.com/paper/2304.09240/) (2023)
- [Harmonious Group Choreography with Trajectory-Controllable Diffusion](https://mlsanity.com/paper/2403.06189/) (2024)
- [ST-GDance: Long-Term and Collision-Free Group Choreography from Music](https://mlsanity.com/paper/2507.21518/) (2025)
- [NFTGAN: Non-Fungible Token Art Generation Using Generative Adversarial Networks](https://mlsanity.com/paper/2112.10577/) (2021)
- [ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreography](https://mlsanity.com/paper/2603.22316/) (2026)

## Abstract (arXiv)

The metaverse, enormous virtual-physical cyberspace, has brought unprecedented opportunities for artists to blend every corner of our physical surroundings with digital creativity. This article conducts a comprehensive survey on computational arts, in which seven critical topics are relevant to the metaverse, describing novel artworks in blended virtual-physical realities. The topics first cover the building elements for the metaverse, e.g., virtual scenes and characters, auditory, textual elements. Next, several remarkable types of novel creations in the expanded horizons of metaverse cyberspace have been reflected, such as immersive arts, robotic arts, and other user-centric approaches fuelling contemporary creative outputs. Finally, we propose several research agendas: democratising computational arts, digital privacy, and safety for metaverse artists, ownership recognition for digital artworks, technological challenges, and so on. The survey also serves as introductory material for artists and metaverse technologists to begin creations in the realm of surrealistic cyberspace.
