mlsanityData to 14 Oct 2026

Contrastive and Multi-Task Learning on Noisy Brain Signals with Nonlinear Dynamical Signatures

arXiv 2601.08549 ↗First posted 13 Jan 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce a two-stage multitask learning framework for analyzing Electroencephalography (EEG) signals that integrates denoising, dynamical modeling, and representation learning. In the first stage, a denoising autoencoder is trained to suppress artifacts and stabilize temporal dynamics, providing robust signal representations. In the second stage, a multitask architecture processes these denoised signals to achieve three objectives: motor imagery classification, chaotic versus non-chaotic regime discrimination using Lyapunov exponent-based labels, and self-supervised contrastive representation learning with NT-Xent loss. A convolutional backbone combined with a Transformer encoder captures spatial-temporal structure, while the dynamical task encourages sensitivity to nonlinear brain dynamics. This staged design mitigates interference between reconstruction and discriminative goals, improves stability across datasets, and supports reproducible training by clearly separating noise reduction from higher-level feature learning. Empirical studies show that our framework not only enhances robustness and generalization but also surpasses strong baselines and recent state-of-the-art methods in EEG decoding, highlighting the effectiveness of combining denoising, dynamical features, and self-supervised learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 58 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

24 of 58 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  9. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
  10. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  11. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  12. 2016Cross-stitch Networks for Multi-task Learningcited by 467
12 more
  1. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
  2. 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 171
  3. 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
  4. 2023Decoding Natural Images from EEG for Object Recognitioncited by 81
  5. 2020EEG-TCNet: An Accurate Temporal Convolutional Network for Embedded Motor-Imagery Brain-Machine Interfacescited by 63
  6. 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 58
  7. 2021FBCNet: A Multi-view Convolutional Neural Network for Brain-Computer Interfacecited by 57
  8. 2019Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRIcited by 41
  9. 2020Lyapunov spectra of chaotic recurrent neural networkscited by 37
  10. 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 36
  11. 2020On Lyapunov Exponents for RNNs: Understanding Information Propagation Using Dynamical Systems Toolscited by 31
  12. 2020Tensorized Transformer for Dynamical Systems Modelingcited by 4

Built on by

Not cited yet.