mlsanityData to 7 Oct 2026

Neonatal Hypoxic-ischaemic Encephalopathy Classification from the EEG and HRV Signals Using a Conformer based Masked Autoencoder

arXiv 2607.23554 ↗First posted 26 Jul 2026cs.LG cs.AI eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose the MAEConformer, a novel self-supervised learning framework that combines the Conformer architecture with the Masked Autoencoder (MAE) paradigm for large-scale representation learning from unlabelled electroencephalography (EEG) and heart rate variability (HRV) signals. By integrating convolutional operations with Transformer-based self-attention, MAEConformer effectively captures both local temporal patterns and long-range contextual dependencies in physiological time series. To enhance reconstruction fidelity and representation quality, a multi-resolution short-time Fourier transform (MR-STFT) loss is incorporated alongside the reconstruction objective, enabling the model to jointly learn temporal and spectral characteristics across multiple scales. Modality-specific EEG and HRV MAEConformer models were pretrained on 6,030h and 4,868h of unlabelled recordings, respectively, and subsequently transferred to expert-annotated downstream tasks. Experimental results demonstrate that the learned representations provide strong transferability and data efficiency. In EEG-based hypoxic ischemic encephalopathy (HIE) severity classification, the pretrained MAE-EEG model achieved test AUCs of 97.19% and 96.56% for binary and four-class classification tasks, respectively, outperforming a range of state-of-the-art supervised and self-supervised baselines. On the HRV-based HIE severity classification task, MAE-HRV achieved a test AUC of 82.42%, surpassing both self-supervised Transformer-based and supervised convolutional baselines. These findings demonstrate the effectiveness of MAEConformer for learning robust and transferable representations across multiple physiological modalities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 49 references that are in the map. First posted on arXiv 26 Jul 2026.

Builds on

28 of 49 references.

References · 28

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  5. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
  6. 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
  7. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
  8. 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 204
  9. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
  10. 2018Training behavior of deep neural network in frequency domaincited by 174
  11. 2022What to Hide from Your Students: Attention-Guided Masked Image Modelingcited by 117
  12. 2022SemMAE: Semantic-Guided Masking for Learning Masked Autoencoderscited by 113
16 more
  1. 2022ConvMAE: Masked Convolution Meets Masked Autoencoderscited by 105
  2. 2022How Mask Matters: Towards Theoretical Understandings of Masked Autoencoderscited by 86
  3. 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 61
  4. 2022Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Localitycited by 57
  5. 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 48
  6. 2022Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformercited by 47
  7. 2023Masked Image Modeling with Local Multi-Scale Reconstructioncited by 43
  8. 2024Fredformer: Frequency Debiased Transformer for Time Series Forecastingcited by 43
  9. 2023Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignalscited by 22
  10. 2022Neuro-BERT: Rethinking Masked Autoencoding for Self-supervised Neurological Pretrainingcited by 14
  11. 2023Masked Autoencoders with Multi-Window Local-Global Attention Are Better Audio Learnerscited by 11
  12. 2023Masked Transformer for Electrocardiogram Classificationcited by 7
  13. 2023Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysiscited by 7
  14. 2024Enhancing Representation Learning of EEG Data with Masked Autoencoderscited by 2
  15. 2025FHRFormer: A Self-supervised Transformer Approach for Fetal Heart Rate Inpainting and Forecastingcited by 1
  16. 2026HRVConformer: Neonatal Hypoxic-Ischemic Encephalopathy Classification from the Heart Rate signalscited by 1

Built on by

Not cited yet.