EEG2Vision: A Multimodal EEG-Based Framework for 2D Visual Reconstruction in Cognitive Neuroscience
Not on the map. Why?
Abstract (arXiv)
Reconstructing visual stimuli from non-invasive electroencephalography (EEG) remains challenging due to its low spatial resolution and high noise, particularly under realistic low-density electrode configurations. To address this, we present EEG2Vision, a modular, end-to-end EEG-to-image framework that systematically evaluates reconstruction performance across different EEG resolutions (128, 64, 32, and 24 channels) and enhances visual quality through a prompt-guided post-reconstruction boosting mechanism. Starting from EEG-conditioned diffusion reconstruction, the boosting stage uses a multimodal large language model to extract semantic descriptions and leverages image-to-image diffusion to refine geometry and perceptual coherence while preserving EEG-grounded structure. Our experiments show that semantic decoding accuracy degrades significantly with channel reduction (e.g., 50-way Top-1 Acc from 89% to 38%), while reconstruction quality slight decreases (e.g., FID from 76.77 to 80.51). The proposed boosting consistently improves perceptual metrics across all configurations, achieving up to 9.71% IS gains in low-channel settings. A user study confirms the clear perceptual preference for boosted reconstructions. The proposed approach significantly boosts the feasibility of real-time brain-2-image applications using low-resolution EEG devices, potentially unlocking this type of applications outside laboratory settings.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
24 of 46 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016Improved Techniques for Training GANscited by 2,938
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
- 2018PieAPP: Perceptual Image-Error Assessment through Pairwise Preferencecited by 158
- 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
- 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 79
- 2016Deep Learning Human Mind for Automated Visual Classificationcited by 76
- 2023DreamDiffusion: Generating High-Quality Images from Brain EEG Signalscited by 56
- 2018Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Featurescited by 52
12 more
- 2023MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusioncited by 47
- 2024NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulationcited by 33
- 2023EEG2IMAGE: Image Reconstruction from EEG Brain Signalscited by 30
- 2023Learning Robust Deep Visual Representations from EEG Brain Recordingscited by 26
- 2024Neuro-3D: Towards 3D Visual Decoding from EEG Signalscited by 23
- 2023Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey)cited by 20
- 2023Seeing through the Brain: Image Reconstruction of Visual Perception from Human Brain Signalscited by 16
- 2024Guess What I Think: Streamlined EEG-to-Image Generation with Latent Diffusion Modelscited by 11
- 2024Towards Neural Foundation Models for Vision: Aligning EEG, MEG, and fMRI Representations for Decoding, Encoding, and Modality Conversioncited by 9
- 2023Gap-closing Matters: Perceptual Quality Evaluation and Optimization of Low-Light Image Enhancementcited by 7
- 2020An Evoked Potential-Guided Deep Learning Brain Representation For Visual Classificationcited by 4
- 2022EEG-based Image Feature Extraction for Visual Classification using Deep Learningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Brain-to-Image Generation: Reconstructing Visual Stimuli from EEG using Generative Adversarial Networks
- 2026Lost in Visual Translation: A VLM-Assisted Perceptual-Semantic Coherence Framework for EEG-to-Image Reconstruction
- 2025Interpretable EEG-to-Image Generation with Semantic Prompts
- 2024EEG-Driven 3D Object Reconstruction with Style Consistency and Diffusion Prior
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models
- 2026Brain3D: EEG-to-3D Decoding of Visual Representations via Multimodal Reasoning
- 2023BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstruction
- 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Information