# Toward Imagined Speech based Smart Communication System: Potential Applications on Metaverse Conditions

arXiv: https://arxiv.org/abs/2112.08569 · HTML: https://mlsanity.com/paper/2112.08569/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Dec 2021.

## Built on by (most cited first, 6 of 6)

- [The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions](https://mlsanity.com/paper/2304.09240/) (2023)
- [Towards Dynamic Neural Communication and Speech Neuroprosthesis Based on Viseme Decoding](https://mlsanity.com/paper/2501.14790/) (2025)
- [Machine Learning-based EEG Applications and Markets](https://mlsanity.com/paper/2208.05144/) (2022)
- [Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networks](https://mlsanity.com/paper/2312.05814/) (2023)
- [Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interface](https://mlsanity.com/paper/2411.09211/) (2024)
- [Cross-Subject Semantic Decoding with Shared-Space Alignment for Generalized Neural Representation Learning](https://mlsanity.com/paper/2607.19394/) (2026)

## Abstract (arXiv)

Metaverse provides an alternative platform for human interaction in the virtual world. Since virtual platform holds few restrictions in changing the surrounding environments or the appearance of the avatars, it can serve as a platform that reflects human thoughts or even dreams at least in the metaverse world. When it is merged together with the current brain-computer interface (BCI) technology, which enables system control via brain signals, a new paradigm of human interaction through mind may be established in the metaverse conditions. Recent BCI systems are aiming to provide user-friendly and intuitive means of communication using brain signals. Imagined speech has become an alternative neuro-paradigm for communicative BCI since it relies directly on a person's speech production process, rather than using speech-unrelated neural activity as the means of communication. In this paper, we propose a brain-to-speech (BTS) system for real-world smart communication using brain signals. Also, we show a demonstration of imagined speech based smart home control through communication with a virtual assistant, which can be one of the future applications of brain-metaverse system. We performed pseudo-online analysis using imagined speech electroencephalography data of nine subjects to investigate the potential use of virtual BTS system in the real-world. Average accuracy of 46.54 % (chance level = 7.7 %) and 75.56 % (chance level = 50 %) was acquired in the thirteen-class and binary pseudo-online analysis, respectively. Our results support the potential of imagined speech based smart communication to be applied in the metaverse world.