mlsanityData to 7 Oct 2026

Aligning What EEG Can See: Structural Representations for Brain-Vision Matching

arXiv 2603.07077 ↗First posted 7 Mar 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Visual decoding from electroencephalography (EEG) has emerged as a highly promising avenue for non-invasive brain-computer interfaces (BCIs). Existing EEG-based decoding methods predominantly align brain signals with the final-layer semantic embeddings of deep visual models. However, relying on these highly abstracted embeddings inevitably leads to severe cross-modal information mismatch. In this work, we introduce the concept of Neural Visibility and accordingly propose the EEG-Visible Layer Selection Strategy, aligning EEG signals with intermediate visual layers to minimize this mismatch. Furthermore, to accommodate the multi-stage nature of human visual processing, we propose a novel Hierarchically Complementary Fusion (HCF) framework that jointly integrates visual representations from different hierarchical levels. Extensive experiments demonstrate that our method achieves state-of-the-art performance, reaching an 84.6% accuracy (+21.4%) on zero-shot visual decoding on the THINGS-EEG dataset. Moreover, our method achieves up to a 129.8% performance gain across diverse EEG baselines, demonstrating its robust generalizability.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

17 of 33 references.

References · 17

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  3. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  4. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  5. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  6. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  7. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
  8. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
  9. 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
  10. 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 79
  11. 2022Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Featurescited by 63
  12. 2016HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detectioncited by 46
5 more
  1. 2025Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur Priorcited by 28
  2. 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 26
  3. 2024Visual Neural Decoding via Improved Visual-EEG Semantic Consistencycited by 21
  4. 2024Neural-MCRL: Neural Multimodal Contrastive Representation Learning for EEG-based Visual Decodingcited by 14
  5. 2025NeuroBridge: Bio-Inspired Self-Supervised EEG-to-Image Decoding via Cognitive Priors and Bidirectional Semantic Alignmentcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.