CognitionCapturerPro: Towards High-Fidelity Visual Decoding from EEG/MEG via Multi-modal Information and Asymmetric Alignment
Not on the map. Why?
Abstract (arXiv)
Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges) via collaborative training. Our core contributions include an uncertainty-weighted similarity scoring mechanism to quantify modality-specific fidelity and a fusion encoder for integrating shared representations. By employing a simplified alignment module and a pre-trained diffusion model, our method significantly outperforms the original CognitionCapturer on the THINGS-EEG dataset, improving Top-1 and Top-5 retrieval accuracy by 25.9% and 10.6%, respectively. Code is available at: https://github.com/XiaoZhangYES/CognitionCapturerPro.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 50 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
26 of 50 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2023Adversarial Diffusion Distillationcited by 741
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2021AudioCLIP: Extending CLIP to Image, Text and Audiocited by 335
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 159
- 2024MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datacited by 105
14 more
- 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
- 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 79
- 2016Deep Learning Human Mind for Automated Visual Classificationcited by 76
- 2023Brain decoding: toward real-time reconstruction of visual perceptioncited by 64
- 2022Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Featurescited by 63
- 2018Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Featurescited by 52
- 2023DREAM: Visual Decoding from Reversing Human Visual Systemcited by 44
- 2022EEG based Emotion Recognition: A Tutorial and Reviewcited by 42
- 2025Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur Priorcited by 28
- 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 26
- 2024Visual Neural Decoding via Improved Visual-EEG Semantic Consistencycited by 21
- 2025NeuroBridge: Bio-Inspired Self-Supervised EEG-to-Image Decoding via Cognitive Priors and Bidirectional Semantic Alignmentcited by 13
- 2025Shrinking the Teacher: An Adaptive Teaching Paradigm for Asymmetric EEG-Vision Alignmentcited by 4
- 2025Multigranular Evaluation for Brain Visual Decodingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025CATVis: Context-Aware Thought Visualization
- 2025Interpretable EEG-to-Image Generation with Semantic Prompts
- 2026EEG2Vision: A Multimodal EEG-Based Framework for 2D Visual Reconstruction in Cognitive Neuroscience
- 2026Lost in Visual Translation: A VLM-Assisted Perceptual-Semantic Coherence Framework for EEG-to-Image Reconstruction
- 2026STAMBRIDGE: Spectral-Temporal Amplitude-aware Mid-Feature Bridge for EEG Visual Decoding
- 2026Multimodal LLMs Can Learn to Read Brain Signals: A Vision--Language Model for Unified Multi-Task EEG Decoding
- 2023BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstruction
- 2024RealMind: Advancing Visual Decoding and Language Interaction via EEG Signals ↗