A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Decoding neural activity into human-interpretable representations is a key research direction in brain-computer interfaces (BCIs) and computational neuroscience. Recent progress in machine learning and generative AI has driven growing interest in transforming non-invasive Electroencephalography (EEG) signals into images, text, and audio. This survey consolidates and analyzes developments across EEG-to-image synthesis, EEG-to-text generation, and EEG-to-audio reconstruction. We conducted a structured literature search across major databases (2017-2025), extracting key information on datasets, generative architectures (GANs, VAEs, transformers, diffusion models), EEG feature-encoding techniques, evaluation metrics, and the major challenges shaping current work in this area. Our review finds that EEG-to-image models predominantly employ encoder-decoder architectures built on GANs, VAEs, or diffusion models; EEG-to-text approaches increasingly leverage transformer-based language models for open-vocabulary decoding; and EEG-to-audio methods commonly map EEG signals to mel-spectrograms that are subsequently rendered into audio using neural vocoders. Despite promising advances, the field remains constrained by small and heterogeneous datasets, limited cross-subject generalization, and the absence of standardized benchmarks. By consolidating methodological trends and available datasets, this survey provides a foundational reference for advancing EEG-based generative AI and supporting reproducible research. We further highlight open-source datasets and baseline implementations to facilitate systematic benchmarking and accelerate progress in EEG-driven neural decoding.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 51 of its 146 references that are in the map. First posted on arXiv 17 Feb 2025.
Builds on
51 of 146 references.
Closest ancestors · 2
Same direction, newest first
- 2024Guess What I Think: Streamlined EEG-to-Image Generation with Latent Diffusion Models17 Sep
- 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion12 Mar
Other references · 49
- 2017Attention Is All You Needcited by 60,361
- 2022Generative Adversarial Networkscited by 5,627
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2016Improved Techniques for Training GANscited by 2,970
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
37 more
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 344
- 2023Decoding Natural Images from EEG for Object Recognitioncited by 81
- 2016Deep Learning Human Mind for Automated Visual Classificationcited by 77
- 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
- 2019ZuCo 2.0: A Dataset of Physiological Recordings During Natural Reading and Annotationcited by 66
- 2023DreamDiffusion: Generating High-Quality Images from Brain EEG Signalscited by 56
- 2018Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Featurescited by 52
- 2023DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translationcited by 36
- 2024Are EEG-to-Text Models Working?cited by 32
- 2023EEG2IMAGE: Image Reconstruction from EEG Brain Signalscited by 30
- 2023Towards Voice Reconstruction from EEG during Imagined Speechcited by 26
- 2023Learning Robust Deep Visual Representations from EEG Brain Recordingscited by 26
- 2024EEG2TEXT: Open Vocabulary EEG-to-Text Decoding with EEG Pre-Training and Multi-View Transformercited by 20
- 2024Self-supervised Learning for Electroencephalogram: A Systematic Surveycited by 19
- 2018Is Generator Conditioning Causally Related to GAN Performance?cited by 18
- 2024Thought2Text: Text Generation from EEG Signal using Large Language Models (LLMs)cited by 18
- 2023Seeing through the Brain: Image Reconstruction of Visual Perception from Human Brain Signalscited by 16
- 2024Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencodercited by 15
- 2021Toward Open-World Electroencephalogram Decoding Via Deep Learning: A Comprehensive Surveycited by 11
- 2020Deep Learning in EEG: Advance of the Last Ten-Year Critical Periodcited by 10
- 2024Unveiling Thoughts: A Review of Advancements in EEG Brain Signal Decoding into Textcited by 10
- 2024BELT-2: Bootstrapping EEG-to-Language representation alignment for multi-task brain decodingcited by 10
- 2023Deep Representation Learning for Open Vocabulary Electroencephalography-to-Text Decodingcited by 9
- 2024Naturalistic Music Decoding from EEG Data via Latent Diffusion Modelscited by 8
- 2024Toward Fully-End-to-End Listened Speech Decoding from EEG Signalscited by 8
- 2025Enhancing Listened Speech Decoding from EEG via Parallel Phoneme Sequence Predictioncited by 6
- 2021Common Spatial Generative Adversarial Networks based EEG Data Augmentation for Cross-Subject Brain-Computer Interfacecited by 4
- 2024What Causes Performance Degradation in Cross-Subject EEG Classification?cited by 4
- 2025Decoding EEG Speech Perception with Transformers and VAE-based Data Augmentationcited by 4
- 2025Neural Spelling: A Spell-Based BCI System for Language Neural Decodingcited by 4
- 2020Advancing Speech Synthesis using EEGcited by 3
- 2021Sinc-based convolutional neural networks for EEG-BCI-based motor imagery classificationcited by 3
- 2022EEG2Mel: Reconstructing Sound from Brain Responses to Musiccited by 3
- 2024Comprehensive Review of EEG-to-Output Research: Decoding Neural Signals into Images, Videos, and Audiocited by 3
- 2025Bridging Brain Signals and Language: A Deep Learning Approach to EEG-to-Text Decodingcited by 3
- 2024GET: A Generative EEG Transformer for Continuous Context-Based Neural Signalscited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Foundation Models for Cross-Domain EEG Analysis Application: A Surveycited by 4
- 2025Transformer-based EEG Decoding: A Surveycited by 3
- 2026An Approach to Simultaneous Acquisition of Real-Time MRI Video, EEG, and Surface EMG for Articulatory, Brain, and Muscle Activity During Speech Productioncited by 2
- 2026An Approach to Simultaneous Acquisition of Real-Time MRI Video, EEG, and Surface EMG for Articulatory, Brain, and Muscle Activity During Speech Production5 Mar 2026
- 2025Foundation Models for Cross-Domain EEG Analysis Application: A Survey21 Aug 2025
- 2025Transformer-based EEG Decoding: A Survey3 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Interpretable EEG-to-Image Generation with Semantic Prompts
- 2026Brain-to-Image Generation: Reconstructing Visual Stimuli from EEG using Generative Adversarial Networks
- 2023Decoding visual brain representations from electroencephalography through Knowledge Distillation and latent diffusion models
- 2025CATVis: Context-Aware Thought Visualization
- 2026Autoregressive Visual Decoding from EEG Signals
- 2025Category-aware EEG image generation based on wavelet transform and contrast semantic loss
- 2026SENSE: Efficient EEG-to-Text via Privacy-Preserving Semantic Retrieval
- 2025Brain-Gen: Towards Interpreting Neural Signals for Stimulus Reconstruction Using Transformers and Latent Diffusion Models