mlsanityData to 14 Oct 2026

Structure-Guided Diffusion Model for EEG-Based Visual Cognition Reconstruction

arXiv 2604.22649 ↗First posted 24 Apr 2026cs.NE cs.CVcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Objective: Decoding visual information from electroencephalography (EEG) is an important problem in neuroscience and brain-computer interface (BCI) research. Existing methods are largely restricted to natural images and categorical representations, with limited capacity to capture structural features and to differentiate objective perception from subjective cognition. We propose a Structure-Guided Diffusion Model (SGDM) that incorporates explicit structural information for EEG-based visual reconstruction. Approach: SGDM is evaluated on the Kilogram abstract visual object dataset and the THINGS natural image dataset using a two-stage generative mechanism. The framework combines a structurally supervised variational autoencoder with a spatiotemporal EEG encoder aligned to a visual embedding space via contrastive learning. Structural information is integrated into a diffusion model through ControlNet to guide image generation from EEG features. Results: SGDM outperforms existing methods on both abstract and natural image datasets. Reconstructed images achieve higher fidelity in low-level visual features and semantic representations, indicating improved decoding accuracy and strong generalization across diverse visual domains. Spatiotemporal analysis of EEG signals further reveals hierarchical structural encoding patterns, consistent with the neural dynamics of visual cognition. Significance: These findings validate the effectiveness of SGDM in capturing explicit structural geometry and generating images with high fidelity to individual cognitive representations. By enabling decoding of complex visual content from EEG signals, the framework extends neural decoding beyond low-dimensional or categorical outputs. This supports BCIs with increased degrees of freedom for intention decoding and more flexible brain-to-machine communication.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 22 of its 47 references that are in the map. First posted on arXiv 24 Apr 2026.

Builds on

22 of 47 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion12 Mar
  2. 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors29 May

Other references · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  7. 2016Improved Techniques for Training GANscited by 2,970
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  9. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  10. 2019Deep learning-based electroencephalography analysis: a systematic reviewcited by 156
  11. 2016Deep Learning Human Mind for Automated Visual Classificationcited by 77
  12. 2018Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Featurescited by 52
8 more
  1. 2015Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networkscited by 45
  2. 2022Abstract Visual Reasoning with Tangram Shapescited by 43
  3. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  4. 2023BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstructioncited by 30
  5. 2023Learning Robust Deep Visual Representations from EEG Brain Recordingscited by 26
  6. 2022Toward reliable signals decoding for electroencephalogram: A benchmark study to EEGNeXcited by 17
  7. 2023DREAM: Diffusion Rectification and Estimation-Adaptive Modelscited by 12
  8. 2024Unveiling Thoughts: A Review of Advancements in EEG Brain Signal Decoding into Textcited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Decoding visual brain representations from electroencephalography through Knowledge Distillation and latent diffusion models
  2. 2024EEG-Driven 3D Object Reconstruction with Style Consistency and Diffusion Prior
  3. 2025Brain-Gen: Towards Interpreting Neural Signals for Stimulus Reconstruction Using Transformers and Latent Diffusion Models
  4. 2023Seeing through the Brain: Image Reconstruction of Visual Perception from Human Brain Signals
  5. 2026EEG2Vision: A Multimodal EEG-Based Framework for 2D Visual Reconstruction in Cognitive Neuroscience
  6. 2025EEGDM: Learning EEG Representation with Latent Diffusion Model
  7. 2025EEGDM: EEG Representation Learning via Generative Diffusion Model
  8. 2026Autoregressive Visual Decoding from EEG Signals