Aligning What EEG Can See: Structural Representations for Brain-Vision Matching
Not on the map. Why?
Abstract (arXiv)
Visual decoding from electroencephalography (EEG) has emerged as a highly promising avenue for non-invasive brain-computer interfaces (BCIs). Existing EEG-based decoding methods predominantly align brain signals with the final-layer semantic embeddings of deep visual models. However, relying on these highly abstracted embeddings inevitably leads to severe cross-modal information mismatch. In this work, we introduce the concept of Neural Visibility and accordingly propose the EEG-Visible Layer Selection Strategy, aligning EEG signals with intermediate visual layers to minimize this mismatch. Furthermore, to accommodate the multi-stage nature of human visual processing, we propose a novel Hierarchically Complementary Fusion (HCF) framework that jointly integrates visual representations from different hierarchical levels. Extensive experiments demonstrate that our method achieves state-of-the-art performance, reaching an 84.6% accuracy (+21.4%) on zero-shot visual decoding on the THINGS-EEG dataset. Moreover, our method achieves up to a 129.8% performance gain across diverse EEG baselines, demonstrating its robust generalizability.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 7 Mar 2026.
Builds on
17 of 33 references.
References · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
- 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
- 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 79
- 2022Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Featurescited by 63
- 2016HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detectioncited by 46
5 more
- 2025Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur Priorcited by 28
- 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 26
- 2024Visual Neural Decoding via Improved Visual-EEG Semantic Consistencycited by 21
- 2024Neural-MCRL: Neural Multimodal Contrastive Representation Learning for EEG-based Visual Decodingcited by 14
- 2025NeuroBridge: Bio-Inspired Self-Supervised EEG-to-Image Decoding via Cognitive Priors and Bidirectional Semantic Alignmentcited by 13
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Beyond Trial Averaging: Anchoring Neural and Visual Representations for Few-Repetition Brain-to-Image Retrievalcited by 0
- 2026SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrievalcited by 0
- 2026Structured Visual Target Learning For Cross-Subject eeg-to-image retrievalcited by 0
- 2026Structured Visual Target Learning For Cross-Subject eeg-to-image retrieval29 Sep 2026
- 2026SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval19 Aug 2026
- 2026Beyond Trial Averaging: Anchoring Neural and Visual Representations for Few-Repetition Brain-to-Image Retrieval19 Aug 2026