MEL: Coordinate-Preserving EEG Tokenization for fMRI Translation
Not on the map. Why?
Abstract (arXiv)
Translating electroencephalography (EEG) into functional magnetic resonance imaging (fMRI) is important for medical neuroimaging, clinical brain-state monitoring, and multimodal neural decoding, because it aims to infer spatially organized hemodynamic activity from fast and accessible electrophysiological recordings. Existing EEG-to-fMRI studies mainly pursue stronger decoders, but the problem is also constrained by a representation-interface mismatch: fMRI responses are delayed, temporally integrated, and spatially distributed, whereas generic EEG encodings often entangle temporal lag, channel identity, and frequency-band structure. We propose Multi-band EEG Latent-state Tokenization (MEL), a coordinate-preserving EEG representation framework that anchors each target fMRI response to its preceding EEG history and organizes it into lag-channel-frequency neural-state tokens. By explicitly capturing hemodynamic latency and spectral-spatial dynamics, MEL aligns fMRI-pertinent EEG representations with capacity-controlled readouts without depending entirely on model scaling. Experiments on VU EEG-fMRI benchmarks and external Oddball data show that MEL improves prediction over strong NeuroBOLT baselines. Ablations and controls further indicate that the gains come from structured EEG representation rather than leakage, shortcut statistics, or decoder capacity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 44 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
16 of 44 references.
References · 16
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 55
- 2023BIOT: Cross-data Biosignal Learning in the Wildcited by 20
- 2024CATD: Unified Representation Learning for EEG-to-fMRI Cross-Modal Generationcited by 11
- 2024NeuroBOLT: Resting-state EEG-to-fMRI Synthesis with Multi-dimensional Feature Mappingcited by 11
- 2024Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusioncited by 9
- 2020EEG to fMRI Synthesis: Is Deep Learning a candidate?cited by 8
- 2022EEG to fMRI Synthesis Benefits from Attentional Graphs of Electrode Relationshipscited by 7
- 2023Leveraging sinusoidal representation networks to predict fMRI signals from EEGcited by 6
- 2022fMRI from EEG is only Deep Learning away: the use of interpretable DL to unravel EEG-fMRI relationshipscited by 4
- 2024NT-ViT: Neural Transcoding Vision Transformers for EEG-to-fMRI Synthesiscited by 4
- 2025From Brainwaves to Brain Scans: A Robust Neural Network for EEG-to-fMRI Synthesiscited by 4
4 more
- 2024Latent Representation Learning for Multimodal Brain Activity Translationcited by 3
- 2025Beyond Regularity: Modeling Chaotic Mobility Patterns for Next Location Predictioncited by 3
- 2025Spec2VolCAMU-Net: A Spectrogram-to-Volume Model for EEG-to-fMRI Reconstruction based on Multi-directional Time-Frequency Convolutional Attention Encoder and Vision-Mamba U-Netcited by 2
- 2026UrbanFM: Scaling Urban Spatio-Temporal Foundation Modelscited by 1
Built on by
Not cited yet.