mlsanityData to 14 Oct 2026

DiffEEG: A Self-Supervised Denoising Diffusion Model for Learning EEG Generic Representations

arXiv 2607.11578 ↗First posted 13 Jul 2026cs.LG cs.AI cs.CVcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Deep learning for EEG-based seizure detection faces critical challenges: severe annotation scarcity and extreme class imbalance, where ictal events comprise less than 10% of clinical recordings. We present DiffEEG, a 9.6M-parameter self-supervised foundation model that addresses both limitations through denoising diffusion pre-training and reinforcement learning (RL)-based fine-tuning. Pre-trained on 1.3M unlabeled segments from the Temple University Hospital Seizure Corpus (TUHSZ), DiffEEG learns generic neural representations via a 1D U-Net with multi-head self-attention. For downstream adaptation, a reinforced decision layer employs policy gradient optimization to directly maximize F1-score, prioritizing sensitivity to rare seizure events over overall accuracy. Under strict patient-wise evaluation (279 patients, Leave-One-Fold-Out), DiffEEG achieves 61% accuracy and 59% F1 for 4-class seizure subtyping, and 81% accuracy with 85% weighted F1 for binary detection, maintaining clinically viable seizure recall (59%) despite extreme imbalance (6.7% prevalence). Segment-level evaluation establishes an upper bound of 97.6% accuracy, confirming strong architectural capacity. DiffEEG demonstrates that diffusion-based pre-training combined with metric-aware reinforcement learning enables clinically deployable seizure monitoring with minimal labeled data requirements.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 17 of its 44 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

17 of 44 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  5. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  6. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  7. 2019Deep learning-based electroencephalography analysis: a systematic reviewcited by 156
  8. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  9. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
  10. 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 52
  11. 2025EEG Foundation Models: A Critical Review of Current Progress and Future Directionscited by 32
  12. 2023BIOT: Cross-data Biosignal Learning in the Wildcited by 20
5 more
  1. 2019Adversarial Representation Learning for Robust Patient-Independent Epileptic Seizure Detectioncited by 14
  2. 2022Reinforcement Learning with Automated Auxiliary Loss Searchcited by 13
  3. 2025BioSerenity-E1: a self-supervised EEG model for medical applicationscited by 4
  4. 2022Wavelet-Based Multi-Class Seizure Type Classification Systemcited by 2
  5. 2024Multi-Branch Mutual-Distillation Transformer for EEG-Based Seizure Subtype Classificationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Data Augmentation for Seizure Prediction with Generative Diffusion Model
  2. 2026Efficient EEG Seizure Detection Using INT8 Quantization, Channel Pruning, and Spiking Neural Networks
  3. 2026Multimodal Pretraining for Generalizable EEG Representation Learning
  4. 2025DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
  5. 2025EEGDM: EEG Representation Learning via Generative Diffusion Model
  6. 2023Knowledge-Distilled Graph Neural Networks for Personalized Epileptic Seizure Detection
  7. 2026DCRA: Diffusion-Conditioned Representation Alignment for Robust Time-Series Learning
  8. 2022Bridging the Gap Between Patient-specific and Patient-independent Seizure Prediction via Knowledge Distillation