mlsanityData to 14 Oct 2026

What Does the Brain See? Multiview Neural Representations to Demystify the Brain-Visual Alignment

arXiv 2606.25718 ↗First posted 24 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Zero-shot visual decoding from electroencephalography (EEG) aims to infer visual semantics from non-invasive neural recordings, but remains challenging due to the low signal-to-noise ratio, non-stationarity, and limited spatial resolution of EEG. Existing EEG-vision alignment methods often rely on holistic EEG embeddings, which can obscure the complementary temporal, spectral, and spatial structure underlying visual perception. We introduce a unified multiview EEG representation learning framework for aligning brain responses with visual semantic embeddings. Our method builds an EEG encoder that jointly models three complementary views: input-conditioned state-space temporal dynamics, learnable wavelet-based spectral decomposition for sample-adaptive frequency modeling, and attention-modulated graph learning for structured electrode interactions. The resulting multiview EEG embeddings are fused and aligned with pretrained visual representations in a shared semantic space using contrastive learning with EEG-specific regularization, enabling 200-way zero-shot visual classification. Experiments on THINGS-EEG benchmark show that our method achieves state-of-the-art performance, with 54.8% Top-1 and 85.6% Top-5 accuracy in the within-subject setting and 15.3% Top-1 and 45.4% Top-5 accuracy in the cross-subject setting. We further present the first systematic cross-session EEG-image decoding evaluation, achieving 40.8% Top-1 and 78.0% Top-5 accuracy. These results suggest that explicitly modeling multiview neural structure improves both semantic alignment and generalization in EEG-based visual decoding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

16 of 32 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2023Decoding Natural Images from EEG for Object Recognitioncited by 81
  5. 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 81
  6. 2016Deep Learning Human Mind for Automated Visual Classificationcited by 77
  7. 2022Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Featurescited by 63
  8. 2023DreamDiffusion: Generating High-Quality Images from Brain EEG Signalscited by 56
  9. 2015Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networkscited by 45
  10. 2025Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur Priorcited by 29
  11. 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 28
  12. 2023Decoding visual brain representations from electroencephalography through Knowledge Distillation and latent diffusion modelscited by 10
4 more
  1. 2025Human-Aligned Image Models Improve Visual Decoding from the Braincited by 7
  2. 2025Category-aware EEG image generation based on wavelet transform and contrast semantic losscited by 3
  3. 2025Spatial-Functional awareness Transformer-based graph archetype contrastive learning for Decoding Visual Neural Representations from EEGcited by 3
  4. 2025UMind: A Unified Multitask Network for Zero-Shot M/EEG Visual Decodingcited by 1

Built on by

Not cited yet.