A multi-level interpretable sleep stage scoring system by infusing experts' knowledge into a deep network architecture
Not on the map. Why?
Abstract (arXiv)
In recent years, deep learning has shown potential and efficiency in a wide area including computer vision, image and signal processing. Yet, translational challenges remain for user applications due to a lack of interpretability of algorithmic decisions and results. This black box problem is particularly problematic for high-risk applications such as medical-related decision-making. The current study goal was to design an interpretable deep learning system for time series classification of electroencephalogram (EEG) for sleep stage scoring as a step toward designing a transparent system. We have developed an interpretable deep neural network that includes a kernel-based layer based on a set of principles used for sleep scoring by human experts in the visual analysis of polysomnographic records. A kernel-based convolutional layer was defined and used as the first layer of the system and made available for user interpretation. The trained system and its results were interpreted in four levels from the microstructure of EEG signals, such as trained kernels and the effect of each kernel on the detected stages, to macrostructures, such as the transition between stages. The proposed system demonstrated greater performance than prior studies and the results of interpretation showed that the system learned information which was consistent with expert knowledge.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 41 of its 133 references that are in the map. First posted on arXiv 11 Jul 2022.
Builds on
41 of 133 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
- 2016Exploring the Limits of Language Modelingcited by 172
29 more
- 2015Attention to Scale: Scale-aware Semantic Image Segmentationcited by 169
- 2017Interpretable Convolutional Neural Networkscited by 161
- 2016Generating Visual Explanationscited by 156
- 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
- 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 90
- 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 87
- 2019Towards Explainable Deep Neural Networks (xDNN)cited by 61
- 2017A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time seriescited by 58
- 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
- 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
- 2018Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learningcited by 46
- 2018Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classificationcited by 42
- 2017Neural network an1alysis of sleep stages enables efficient diagnosis of narcolepsycited by 39
- 2017Spatial-Temporal Recurrent Neural Network for Emotion Recognitioncited by 37
- 2019Towards More Accurate Automatic Sleep Staging via Deep Transfer Learningcited by 31
- 2015Multilingual Language Processing From Bytescited by 26
- 2016Mixed Neural Network Approach for Temporal Sleep Stage Classificationcited by 23
- 2019WaveletKernelNet: An Interpretable Deep Neural Network for Industrial Intelligent Diagnosiscited by 23
- 2016Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networkscited by 21
- 2017Deep Convolutional Neural Networks for Interpretable Analysis of EEG Sleep Stage Scoringcited by 15
- 2020CGCNN: Complex Gabor Convolutional Neural Network on raw speechcited by 9
- 2017Gabor Filter Assisted Energy Efficient Fast Learning Convolutional Neural Networkscited by 8
- 2018Personalizing deep learning models for automatic sleep stagingcited by 8
- 2019SLEEPER: interpretable Sleep staging via Prototypes from Expert Rulescited by 7
- 2022Automated Sleep Staging via Parallel Frequency-Cut Attentioncited by 7
- 2019Naive Gabor Networks for Hyperspectral Image Classificationcited by 5
- 2020Personalized Automatic Sleep Staging with Single-Night Data: a Pilot Study with KL-Divergence Regularizationcited by 5
- 2018Diffuse to fuse EEG spectra -- intrinsic geometry of sleep dynamics for classificationcited by 4
- 2019End-to-end Sleep Staging with Raw Single Channel EEG using Deep Residual ConvNetscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025FIC-TSC: Learning Time Series Classification with Fisher Information Constraintcited by 2
- 2025Interpretable Recognition of Fused Magnesium Furnace Working Conditions with Deep Convolutional Stochastic Configuration Networkscited by 0
- 2026SleepVLM: A Rule-Grounded Vision-Language Model for Auditable Sleep Stagingcited by 0
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasetscited by 0
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasets6 Jul 2026
- 2026SleepVLM: A Rule-Grounded Vision-Language Model for Auditable Sleep Staging22 Mar 2026
- 2025FIC-TSC: Learning Time Series Classification with Fisher Information Constraint9 May 2025
- 2025Interpretable Recognition of Fused Magnesium Furnace Working Conditions with Deep Convolutional Stochastic Configuration Networks6 Jan 2025