EEG to fMRI Synthesis Benefits from Attentional Graphs of Electrode Relationships
Not on the map. Why?
Abstract (arXiv)
Topographical structures represent connections between entities and provide a comprehensive design of complex systems. Currently these structures are used to discover correlates of neuronal and haemodynamical activity. In this work, we incorporate them with neural processing techniques to perform regression, using electrophysiological activity to retrieve haemodynamics. To this end, we use Fourier features, attention mechanisms, shared space between modalities and incorporation of style in the latent representation. By combining these techniques, we propose several models that significantly outperform current state-of-the-art of this task in resting state and task-based recording settings. We report which EEG electrodes are the most relevant for the regression task and which relations impacted it the most. In addition, we observe that haemodynamic activity at the scalp, in contrast with sub-cortical regions, is relevant to the learned shared space. Overall, these results suggest that EEG electrode relationships are pivotal to retain information necessary for haemodynamical activity retrieval.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 11 of its 53 references that are in the map. First posted on arXiv 7 Mar 2022.
Builds on
11 of 53 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2018DARTS: Differentiable Architecture Searchcited by 1,782
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
- 2016Medical Image Synthesis with Context-Aware Generative Adversarial Networkscited by 91
- 2017Deep MR to CT Synthesis using Unpaired Datacited by 86
- 2018Dist-GAN: An Improved GAN using Distance Constraintscited by 26
- 2022Learning strides in convolutional neural networkscited by 25
- 2021Robust learning from corrupted EEG with dynamic spatial filteringcited by 14
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 2.
7 papers.
- 2024NeuroBOLT: Resting-state EEG-to-fMRI Synthesis with Multi-dimensional Feature Mappingcited by 11
- 2024NT-ViT: Neural Transcoding Vision Transformers for EEG-to-fMRI Synthesiscited by 4
- 2025From Brainwaves to Brain Scans: A Robust Neural Network for EEG-to-fMRI Synthesiscited by 4
- 2025Spec2VolCAMU-Net: A Spectrogram-to-Volume Model for EEG-to-fMRI Reconstruction based on Multi-directional Time-Frequency Convolutional Attention Encoder and Vision-Mamba U-Netcited by 2
- 2025EEG-to-fMRI synthesis of task-evoked and spontaneous brain activity: addressing issues of statistical significance and generalizabilitycited by 0
- 2026Modeling Spatiotemporal Neural Frames for High Resolution Brain Dynamiccited by 0
- 2026MEL: Coordinate-Preserving EEG Tokenization for fMRI Translationcited by 0
- 2026MEL: Coordinate-Preserving EEG Tokenization for fMRI Translation29 Aug 2026
- 2026Modeling Spatiotemporal Neural Frames for High Resolution Brain Dynamic25 Mar 2026
- 2025Spec2VolCAMU-Net: A Spectrogram-to-Volume Model for EEG-to-fMRI Reconstruction based on Multi-directional Time-Frequency Convolutional Attention Encoder and Vision-Mamba U-Net14 May 2025
- 2025EEG-to-fMRI synthesis of task-evoked and spontaneous brain activity: addressing issues of statistical significance and generalizability14 Apr 2025
- 2025From Brainwaves to Brain Scans: A Robust Neural Network for EEG-to-fMRI Synthesis11 Feb 2025
- 2024NeuroBOLT: Resting-state EEG-to-fMRI Synthesis with Multi-dimensional Feature Mapping7 Oct 2024
- 2024NT-ViT: Neural Transcoding Vision Transformers for EEG-to-fMRI Synthesis18 Sep 2024