mlsanityData to 14 Oct 2026

CRIA: A Cross-View Interaction and Instance-Adapted Pre-training Framework for Generalizable EEG Representations

arXiv 2506.16056 ↗First posted 19 Jun 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The difficulty of extracting deep features from EEG data and effectively integrating information from multiple views presents significant challenges for developing a generalizable pretraining framework for EEG representation learning. However, most existing pre-training methods rely solely on the contextual semantics of a single view, failing to capture the complex and synergistic interactions among different perspectives, limiting the expressiveness and generalization of learned representations. To address these issues, this paper proposes CRIA, an adaptive framework that utilizes variable-length and variable-channel coding to achieve a unified representation of EEG data across different datasets. In this work, we define cross-view information as the integrated representation that emerges from the interaction among temporal, spectral, and spatial views of EEG signals. The model employs a cross-attention mechanism to fuse temporal, spectral, and spatial features effectively, and combines an attention matrix masking strategy based on the information bottleneck principle with a novel viewpoint masking pre-training scheme. Experimental results on the Temple University EEG corpus and the CHB-MIT dataset show that CRIA outperforms existing methods with the same pre-training conditions, achieving a balanced accuracy of 57.02% for multi-class event classification and 80.03% for anomaly detection, highlighting its strong generalization ability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 62 references that are in the map. First posted on arXiv 19 Jun 2025.

Builds on

23 of 62 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  7. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
  8. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
  9. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  10. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  11. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  12. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
11 more
  1. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  2. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  3. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  4. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
  5. 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 55
  6. 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 52
  7. 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 50
  8. 2021LGGNet: Learning from Local-Global-Graph Representations for Brain-Computer Interfacecited by 36
  9. 2018ChronoNet: A Deep Recurrent Neural Network for Abnormal EEG Identificationcited by 27
  10. 2024Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusioncited by 9
  11. 2024Comparative Analysis of Deep Learning Approaches for Harmful Brain Activity Detection Using EEGcited by 2

Built on by

Not cited yet.