Diff-E: Diffusion-based Learning for Decoding Imagined Speech EEG
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Decoding EEG signals for imagined speech is a challenging task due to the high-dimensional nature of the data and low signal-to-noise ratio. In recent years, denoising diffusion probabilistic models (DDPMs) have emerged as promising approaches for representation learning in various domains. Our study proposes a novel method for decoding EEG signals for imagined speech using DDPMs and a conditional autoencoder named Diff-E. Results indicate that Diff-E significantly improves the accuracy of decoding EEG signals for imagined speech compared to traditional machine learning techniques and baseline models. Our findings suggest that DDPMs can be an effective tool for EEG signal decoding, with potential implications for the development of brain-computer interfaces that enable communication through imagined speech.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 14 of its 35 references that are in the map. First posted on arXiv 26 Jul 2023.
Builds on
14 of 35 references.
References · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Cyclical Learning Rates for Training Neural Networkscited by 629
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
- 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 157
- 2022Unsupervised Representation Learning from Pre-trained Diffusion Probabilistic Modelscited by 54
Built on by
Citing papers per year: 2023: 2; 2024: 7; 2025: 7; 2026: 1.
17 papers.
Sort:
By area:
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 67
- 2024RespDiff: An End-to-End Multi-scale RNN Diffusion Model for Respiratory Waveform Estimation from PPG Signalscited by 6
- 2024Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversioncited by 4
- 2023D3A-TS: Denoising-Driven Data Augmentation in Time Seriescited by 3
- 2025Towards Dynamic Neural Communication and Speech Neuroprosthesis Based on Viseme Decodingcited by 2
- 2025Decoding Covert Speech from EEG Using a Functional Areas Spatio-Temporal Transformercited by 2
- 2024Towards Unified Neural Decoding of Perceived, Spoken and Imagined Speech from EEG Signalscited by 1
- 2025EEGDM: Learning EEG Representation with Latent Diffusion Modelcited by 1
- 2025MultiDiffNet: A Multi-Objective Diffusion Framework for Generalizable Brain Decodingcited by 1
- 2023Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networkscited by 0
- 2024An Audio-textual Diffusion Model For Converting Speech Signals Into Ultrasound Tongue Imaging Datacited by 0
- 2024Towards Scalable Handwriting Communication via EEG Decoding and Latent Embedding Integrationcited by 0
5 more
- 2024Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interfacecited by 0
- 2025Reconstructing Unseen Sentences from Speech-related Biosignals for Open-vocabulary Neural Communicationcited by 0
- 2025Distinct Theta Synchrony across Speech Modes: Perceived, Spoken, Whispered, and Imaginedcited by 0
- 2025Lightweight Diffusion-based Framework for Online Imagined Speech Decoding in Aphasiacited by 0
- 2026Synthetic Data Generation for Brain-Computer Interfaces: Overview, Benchmarking, and Future Directionscited by 0
- 2026Synthetic Data Generation for Brain-Computer Interfaces: Overview, Benchmarking, and Future Directions11 Mar 2026
- 2025MultiDiffNet: A Multi-Objective Diffusion Framework for Generalizable Brain Decoding23 Nov 2025
- 2025Lightweight Diffusion-based Framework for Online Imagined Speech Decoding in Aphasia11 Nov 2025
- 2025Distinct Theta Synchrony across Speech Modes: Perceived, Spoken, Whispered, and Imagined11 Nov 2025
- 2025Reconstructing Unseen Sentences from Speech-related Biosignals for Open-vocabulary Neural Communication31 Oct 2025
- 2025EEGDM: Learning EEG Representation with Latent Diffusion Model28 Aug 2025
- 2025Decoding Covert Speech from EEG Using a Functional Areas Spatio-Temporal Transformer2 Apr 2025
- 2025Towards Dynamic Neural Communication and Speech Neuroprosthesis Based on Viseme Decoding9 Jan 2025
- 2024Towards Unified Neural Decoding of Perceived, Spoken and Imagined Speech from EEG Signals14 Nov 2024
- 2024Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interface14 Nov 2024
- 2024Towards Scalable Handwriting Communication via EEG Decoding and Latent Embedding Integration14 Nov 2024
- 2024RespDiff: An End-to-End Multi-scale RNN Diffusion Model for Respiratory Waveform Estimation from PPG Signals6 Oct 2024
5 more
- 2024Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversion11 May 2024
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Data29 Apr 2024
- 2024An Audio-textual Diffusion Model For Converting Speech Signals Into Ultrasound Tongue Imaging Data9 Mar 2024
- 2023Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networks10 Dec 2023
- 2023D3A-TS: Denoising-Driven Data Augmentation in Time Series9 Dec 2023
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 67
- 2024Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversioncited by 4
- 2025EEGDM: Learning EEG Representation with Latent Diffusion Modelcited by 1
- 2024An Audio-textual Diffusion Model For Converting Speech Signals Into Ultrasound Tongue Imaging Datacited by 0
- 2025EEGDM: Learning EEG Representation with Latent Diffusion Model28 Aug 2025
- 2024Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversion11 May 2024
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Data29 Apr 2024
- 2024An Audio-textual Diffusion Model For Converting Speech Signals Into Ultrasound Tongue Imaging Data9 Mar 2024
- 2024RespDiff: An End-to-End Multi-scale RNN Diffusion Model for Respiratory Waveform Estimation from PPG Signalscited by 6
- 2023D3A-TS: Denoising-Driven Data Augmentation in Time Seriescited by 3
- 2025Towards Dynamic Neural Communication and Speech Neuroprosthesis Based on Viseme Decodingcited by 2
- 2025Decoding Covert Speech from EEG Using a Functional Areas Spatio-Temporal Transformercited by 2
- 2024Towards Unified Neural Decoding of Perceived, Spoken and Imagined Speech from EEG Signalscited by 1
- 2025MultiDiffNet: A Multi-Objective Diffusion Framework for Generalizable Brain Decodingcited by 1
- 2023Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networkscited by 0
- 2024Towards Scalable Handwriting Communication via EEG Decoding and Latent Embedding Integrationcited by 0
- 2024Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interfacecited by 0
- 2025Reconstructing Unseen Sentences from Speech-related Biosignals for Open-vocabulary Neural Communicationcited by 0
- 2025Distinct Theta Synchrony across Speech Modes: Perceived, Spoken, Whispered, and Imaginedcited by 0
- 2025Lightweight Diffusion-based Framework for Online Imagined Speech Decoding in Aphasiacited by 0
12 most cited of 13 All 13 (JSON)
- 2026Synthetic Data Generation for Brain-Computer Interfaces: Overview, Benchmarking, and Future Directions11 Mar 2026
- 2025MultiDiffNet: A Multi-Objective Diffusion Framework for Generalizable Brain Decoding23 Nov 2025
- 2025Lightweight Diffusion-based Framework for Online Imagined Speech Decoding in Aphasia11 Nov 2025
- 2025Distinct Theta Synchrony across Speech Modes: Perceived, Spoken, Whispered, and Imagined11 Nov 2025
- 2025Reconstructing Unseen Sentences from Speech-related Biosignals for Open-vocabulary Neural Communication31 Oct 2025
- 2025Decoding Covert Speech from EEG Using a Functional Areas Spatio-Temporal Transformer2 Apr 2025
- 2025Towards Dynamic Neural Communication and Speech Neuroprosthesis Based on Viseme Decoding9 Jan 2025
- 2024Towards Unified Neural Decoding of Perceived, Spoken and Imagined Speech from EEG Signals14 Nov 2024
- 2024Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interface14 Nov 2024
- 2024Towards Scalable Handwriting Communication via EEG Decoding and Latent Embedding Integration14 Nov 2024
- 2024RespDiff: An End-to-End Multi-scale RNN Diffusion Model for Respiratory Waveform Estimation from PPG Signals6 Oct 2024
- 2023Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networks10 Dec 2023
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Brain-Driven Representation Learning Based on Diffusion Model
- 2024EEG-Based Speech Decoding: A Novel Approach Using Multi-Kernel Ensemble Diffusion Models
- 2026Addressing Limited Data in Auditory Attention Decoding with Diffusion Generative Models
- 2025EEGDM: EEG Representation Learning via Generative Diffusion Model
- 2025A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond
- 2024Synthesizing EEG Signals from Event-Related Potential Paradigms with Conditional Diffusion Models
- 2025Synthetic EEG Generation using Diffusion Models for Motor Imagery Tasks
- 2025LLMs Help Alleviate the Cross-Subject Variability in Brain Signal and Language Alignment