mlsanityData to 14 Oct 2026

RobustSeiz: An Open-Source Framework for Benchmarking the Robustness of EEG Seizure Detection Models

arXiv 2609.04007 ↗First posted 3 Sep 2026cs.LG eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite strong performance on held-out electroencephalography (EEG) data, seizure detectors may fail under real-world acquisition variability, artifacts, and adversarial inputs. We introduce RobustSeiz, an open-source, model-agnostic framework that provides a standardized, reproducible protocol for stress-testing and comparing seizure detectors under controlled, clinically motivated distribution shifts before deployment. We standardize four public scalp-EEG corpora (CHB-MIT, TUSZ, Siena, and SeizeIT1) into BIDS-EEG trees and evaluate subject-independent detectors on held-out splits. Environment, noise, and adversarial transforms are swept over predefined hyperparameter grids. Each run reports sample- and event-level sensitivity, precision, F1, false positives per 24 h, Lead and Lag onset timing, and Monte Carlo dropout predictive agreement. RobustSeiz includes a Dockerized GPU pipeline, experiment registry, and full-evaluation and research-subset modes. We demonstrate the framework with a contemporary seizure detector on TUSZ across the complete implemented shift grid; an AWGN analysis illustrates how perturbation severity changes detection quality, onset timing, and predictive agreement. RobustSeiz provides a shared benchmarking standard for evaluating seizure-detector robustness under realistic clinical stressors, extending pre-deployment assessment beyond clean-data accuracy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 62 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

20 of 62 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  6. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  7. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  8. 2018Model Cards for Model Reportingcited by 1,080
  9. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  10. 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
  11. 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
  12. 2019Hidden Stratification Causes Clinically Meaningful Failures in Machine Learning for Medical Imagingcited by 216
8 more
  1. 2019Deep learning-based electroencephalography analysis: a systematic reviewcited by 156
  2. 2018The Temple University Hospital Seizure Detection Corpuscited by 83
  3. 2017Cross-validation failure: small sample sizes lead to large error barscited by 43
  4. 2021An Empirical Framework for Domain Generalization in Clinical Settingscited by 32
  5. 2022Evaluating Latent Space Robustness and Uncertainty of EEG-ML Models under Realistic Distribution Shiftscited by 16
  6. 2024SzCORE: A Seizure Community Open-source Research Evaluation framework for the validation of EEG-based automated seizure detection algorithmscited by 16
  7. 2017Objective evaluation metrics for automatic classification of EEG eventscited by 13
  8. 2023Hierarchical Event Descriptor library schema for EEG data annotationcited by 2

Built on by

Not cited yet.