mlsanityData to 7 Oct 2026

Neuroscience-inspired Staged Representation Learning with Disentangled Coarse- and Fine-Grained Semantics for EEG Visual Decoding

arXiv 2605.16923 ↗First posted 16 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG embedding for cross-modal alignment, but they largely overlook the staged and hierarchical characteristics of human visual processing. To address this limitation, we propose a neuroscience-inspired staged representation learning framework that reformulates EEG visual decoding as a stage-specific representation decomposition problem. The proposed framework organizes EEG representation learning into three complementary phases: low-level visual representation learning, high-level semantic representation learning, and integrative information fusion. To strengthen semantic modeling, we further introduce a multimodal dual-level semantic learning mechanism that separates coarse label-level semantics from fine image-level visual-semantic information. In addition, semantic latent channels are introduced as computational representation channels generated from observed visual EEG signals, expanding the channel-level semantic representation space for structured semantic abstraction and cross-modal alignment. Extensive experiments on the THINGS-EEG benchmark demonstrate that the proposed method achieves superior performance under subject-dependent zero-shot evaluation and improved exact retrieval under subject-independent zero-shot evaluation. Additional analyses, including layer-wise retrieval, temporal accumulation, expanded multi-image retrieval, and ablation studies, further support the effectiveness of staged decomposition and structured semantic modeling. These results suggest that explicitly modeling staged perceptual, semantic, and integrative representations provides an effective neuroscience-inspired framework for EEG-based visual decoding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 29 references that are in the map. First posted on arXiv 16 May 2026.

Builds on

8 of 29 references.

References · 8

  1. 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
  2. 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 79
  3. 2022Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Featurescited by 63
  4. 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 26
  5. 2024Visual Neural Decoding via Improved Visual-EEG Semantic Consistencycited by 21
  6. 2023Decoding visual brain representations from electroencephalography through Knowledge Distillation and latent diffusion modelscited by 10
  7. 2025Human-Aligned Image Models Improve Visual Decoding from the Braincited by 7
  8. 2025Category-aware EEG image generation based on wavelet transform and contrast semantic losscited by 3

Built on by

Not cited yet.