mlsanityData to 7 Oct 2026

D-FaST: Cognitive Signal Decoding with Disentangled Frequency-Spatial-Temporal Attention

arXiv 2406.02602 ↗First posted 2 Jun 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Cognitive Language Processing (CLP), situated at the intersection of Natural Language Processing (NLP) and cognitive science, plays a progressively pivotal role in the domains of artificial intelligence, cognitive intelligence, and brain science. Among the essential areas of investigation in CLP, Cognitive Signal Decoding (CSD) has made remarkable achievements, yet there still exist challenges related to insufficient global dynamic representation capability and deficiencies in multi-domain feature integration. In this paper, we introduce a novel paradigm for CLP referred to as Disentangled Frequency-Spatial-Temporal Attention(D-FaST). Specifically, we present an novel cognitive signal decoder that operates on disentangled frequency-space-time domain attention. This decoder encompasses three key components: frequency domain feature extraction employing multi-view attention, spatial domain feature extraction utilizing dynamic brain connection graph attention, and temporal feature extraction relying on local time sliding window attention. These components are integrated within a novel disentangled framework. Additionally, to encourage advancements in this field, we have created a new CLP dataset, MNRED. Subsequently, we conducted an extensive series of experiments, evaluating D-FaST's performance on MNRED, as well as on publicly available datasets including ZuCo, BCIC IV-2A, and BCIC IV-2B. Our experimental results demonstrate that D-FaST outperforms existing methods significantly on both our datasets and traditional CSD datasets including establishing a state-of-the-art accuracy score 78.72% on MNRED, pushing the accuracy score on ZuCo to 78.35%, accuracy score on BCIC IV-2A to 74.85% and accuracy score on BCIC IV-2B to 76.81%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 76 references that are in the map. First posted on arXiv 2 Jun 2024.

Builds on

27 of 76 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2017Squeeze-and-Excitation Networkscited by 4,763
  6. 2014Going Deeper with Convolutionscited by 4,231
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  9. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  11. 2020A Generalization of Transformer Networks to Graphscited by 653
  12. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
15 more
  1. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
  2. 2022Transformer Quality in Linear Timecited by 189
  3. 2022Brain Network Transformercited by 92
  4. 2021Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attentioncited by 86
  5. 2018Transfer Learning for Brain-Computer Interfaces: A Euclidean Space Data Alignment Approachcited by 76
  6. 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
  7. 2022FBNETGEN: Task-aware GNN-based fMRI Analysis via Functional Brain Network Generationcited by 66
  8. 2022Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Featurescited by 63
  9. 2022Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysiscited by 58
  10. 2018Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Featurescited by 52
  11. 2023BrainNet: Epileptic Wave Detection from SEEG with Hierarchical Graph Diffusion Learningcited by 25
  12. 2022Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?cited by 20
  13. 2020Deep Learning in EEG: Advance of the Last Ten-Year Critical Periodcited by 10
  14. 2022Priming Cross-Session Motor Imagery Classification with A Universal Deep Domain Adaptation Frameworkcited by 7
  15. 2019EEG Signal Dimensionality Reduction and Classification using Tensor Decomposition and Deep Convolutional Neural Networkscited by 1

Built on by

Not cited yet.