Non-invasive Neural Decoding in Source Reconstructed Brain Space
Not on the map. Why?
Abstract (arXiv)
Non-invasive brainwave decoding is usually done using Magneto/Electroencephalography (MEG/EEG) sensor measurements as inputs. This makes combining datasets and building models with inductive biases difficult as most datasets use different scanners and the sensor arrays have a nonintuitive spatial structure. In contrast, fMRI scans are acquired directly in brain space, a voxel grid with a typical structured input representation. By using established techniques to reconstruct the sensors' sources' neural activity it is possible to decode from voxels for MEG data as well. We show that this enables spatial inductive biases, spatial data augmentations, better interpretability, zero-shot generalisation between datasets, and data harmonisation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 92 references that are in the map. First posted on arXiv 20 Oct 2024.
Builds on
26 of 92 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 807
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 720
14 more
- 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
- 2022Decoding speech perception from non-invasive brain recordingscited by 130
- 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
- 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
- 2023Brain decoding: toward real-time reconstruction of visual perceptioncited by 66
- 2023DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translationcited by 36
- 2022Data augmentation for learning predictive models on EEG: a systematic comparisoncited by 33
- 2019CogniVal: A Framework for Cognitive Word Embedding Evaluationcited by 27
- 2024The Brain's Bitter Lesson: Scaling Speech Decoding With Self-Supervised Learningcited by 21
- 2024MAD: Multi-Alignment MEG-to-Text Decodingcited by 15
- 2017A Comparison of Audio Signal Preprocessing Methods for Deep Neural Networks on Music Taggingcited by 7
- 2022Group-level Brain Decoding with Deep Learningcited by 7
- 2024Latent Representation Learning for Multimodal Brain Activity Translationcited by 3
- 2024MindSemantix: Deciphering Brain Visual Experiences with a Brain-Language Modelcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
- 2025Unlocking Non-Invasive Brain-to-Textcited by 15
- 2026CANDLE: Cortical Null-Space Decomposition for Noninvasive Brain Source Imagingcited by 0
- 2026CANDLE: Cortical Null-Space Decomposition for Noninvasive Brain Source Imaging6 Oct 2026
- 2025Unlocking Non-Invasive Brain-to-Text19 May 2025