mlsanityData to 14 Oct 2026

Brain-to-Image Generation: Reconstructing Visual Stimuli from EEG using Generative Adversarial Networks

arXiv 2609.22282 ↗First posted 13 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing visual stimuli from electroencephalography (EEG) is difficult because scalp measurements have high temporal but limited spatial resolution, and paired EEG-image datasets remain small relative to modern generative-model training corpora. We present a reproducible single-subject baseline on THINGS-EEG2 that first tests the more defensible question of whether EEG can retrieve the viewed stimulus in a visual embedding space. A compact temporal-spatial convolutional encoder maps repetition-averaged EEG (63 by 250) to provided 512-dimensional ViT-B/32 image features. Model selection uses a concept-disjoint validation split, and final evaluation uses the official 200-image, 200-concept test gallery. Across three training seeds, the model obtains 12.83 +/- 0.58%, 39.17 +/- 1.76%, and 58.00 +/- 1.73% image recall at 1, 5, and 10 (mean +/- sample standard deviation), compared with analytical chance levels of 0.5%, 2.5%, and 5.0%. A session-balanced ablation shows that averaging more test repetitions generally improves ranking. Applying the Subject 01 model to the other nine subjects without adaptation causes a sharp performance drop, exposing subject specificity. We further report exploratory stress tests of direct conditional generators trained without external visual weights: single-subject and ten-subject variants produce noise-dominated outputs, with early validation improvements reversing after one to four epochs. Finally, we distinguish direct reconstruction from semantic rendering with a pretrained diffusion prior. The results support above-chance coarse semantic decoding under a closed-set, repetition-averaged protocol, but do not support faithful recovery of stimulus pixels.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

10 of 17 references.

References · 10

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Adversarial Diffusion Distillationcited by 759
  4. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  5. 2023Decoding Natural Images from EEG for Object Recognitioncited by 81
  6. 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 81
  7. 2016Deep Learning Human Mind for Automated Visual Classificationcited by 77
  8. 2018Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Featurescited by 52
  9. 2025Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur Priorcited by 29
  10. 2018Training on the test set? An analysis of Spampinato et al. [31]cited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EEG2Vision: A Multimodal EEG-Based Framework for 2D Visual Reconstruction in Cognitive Neuroscience
  2. 2025Interpretable EEG-to-Image Generation with Semantic Prompts
  3. 2023Seeing through the Brain: Image Reconstruction of Visual Perception from Human Brain Signals
  4. 2023BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstruction
  5. 2025A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond
  6. 2026Visualizing the Invisible: Generative Visual Grounding Empowers Universal EEG Understanding in MLLMs
  7. 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models
  8. 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Information