SYNAPSE: Neuro-Symbolic Visual Thought-to-Text Decoding via Topological Semantic Denoising
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advances in large language models have accelerated open-vocabulary EEG-to-imagined-text decoding, where non-invasive neural activity recorded during visual perception is translated into coherent natural language descriptions of viewed stimuli. However, existing systems remain highly vulnerable to biological noise, where corrupted neural projections induce hallucinated or semantically unstable generation in frozen language models. We introduce SYNAPSE (Symbolic Neural Alignment for Precise Semantic Extraction), a lightweight neuro-symbolic framework that stabilizes neural text generation through inference-time symbolic regularization. By purifying EEG-derived semantic candidates using commonsense graph structure and latent exemplars, SYNAPSE improves semantic stability without end-to-end LLM fine-tuning. Experiments across popular EEG decoding benchmarks and multiple frozen LLM backends demonstrate consistent gains over unconstrained prompting baselines, robustness under object-label ablation, and performance commensurate with substantially more resource-intensive fine-tuned systems, while preserving biometric privacy by localizing raw EEG processing entirely within the encoder stack.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 25 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
10 of 25 references.
References · 10
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2025OpenAI GPT-5 System Cardcited by 989
- 2023Brain decoding: toward real-time reconstruction of visual perceptioncited by 66
- 2025Brain-to-Text Decoding: A Non-invasive Approach via Typingcited by 22
- 2025Learning Interpretable Representations Leads to Semantically Faithful EEG-to-Text Generationcited by 5
- 2025On Creating A Brain-To-Text Decodercited by 3
- 2025ETS: Open Vocabulary Electroencephalography-To-Text Decoding and Sentiment Classificationcited by 3
- 2026SENSE: Efficient EEG-to-Text via Privacy-Preserving Semantic Retrievalcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SYNAPSE: Synergizing an Adapter and Finetuning for High-Fidelity EEG Synthesis from a CLIP-Aligned Encoder
- 2026BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Language
- 2024SEE: Semantically Aligned EEG-to-Text Translation
- 2024RealMind: Advancing Visual Decoding and Language Interaction via EEG Signals ↗
- 2025Interpretable EEG-to-Image Generation with Semantic Prompts
- 2025Decoding the Multimodal Mind: Generalizable Brain-to-Text Translation via Multimodal Alignment and Adaptive Routing
- 2024BrainECHO: Semantic Brain Signal Decoding through Vector-Quantized Spectrogram Reconstruction for Whisper-Enhanced Text Generation
- 2026Brain-CLIPLM: Semantic Compression for EEG-to-Text Decoding