See the Emotion: A Facial Emoji Proxy Modeling for EEG Emotion Recognition
Not on the map. Why?
Abstract (arXiv)
Despite the high accuracy of EEG-based emotion recognition, existing models remain opaque "black boxes", lacking semantic grounding between abstract neural features and human-interpretable states. In this paper, we reframe EEG explainability as a cross-modal generation task, shifting the paradigm from feature attribution to behavioral visualization. We introduce Facial Emoji Proxy Modeling, a novel framework that translates high-dimensional EEG signals into identity-anonymized facial emojis. Guided by the neuroscientific inspiration of neural-facial association, this approach grounds neural representations in the manifold of observable facial dynamics. Technically, our framework integrates FMENet, a specialized backbone modeling expression-relevant spatial synergies, and the Facial Emoji Learning Branch (FELB), which treats emoji reconstruction as a structured semantic regularizer. Extensive experiments on EAV and MMER benchmarks demonstrate that our method achieves state-of-the-art accuracy among EEG-only models. Crucially, it generates semantically faithful facial animations that provide a transparent, privacy-preserving window into the brain's emotional evolution, effectively allowing users to "see the emotion" directly from neural signals. Code is available at https://github.com/xian-sh/SeeEmotion
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 3 of its 47 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
3 of 47 references.
References · 3
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 74
- 2025Hypergraph Multi-Modal Learning for EEG-based Emotion Recognition in Conversationcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.