ViTexSZ: Heterogeneous Vision-Text Knowledge Distillation for EEG Seizure Detection
On the map: Knowledge distillation → Distillation for medical imaging
Abstract (arXiv)
Automated seizure detection from electroencephalography (EEG) is essential for continuous neurological monitoring, particularly for subclinical epileptic seizures that may exhibit only subtle electrographic changes. Existing time-series methods are often designed for fixed EEG channel configurations, thereby limiting their applicability to heterogeneous EEG recordings with irregular channel layouts. Although visual and language modeling offer promising alternatives, aligning heterogeneous EEG representations with clinical semantics remains challenging. We introduce ViTexSZ, a heterogeneous Vision-Text knowledge distillation framework for EEG seizure detection. ViTexSZ converts EEG recordings into structured waveform images and introduces a query-based multi-channel alignment module that maps source-dependent visual features into a unified token space. A heterogeneous teacher further integrates the aligned EEG representations with clinical prompts through a multimodal large language model, associating high-level clinical semantics with seizure-related evidence. Vision-text knowledge distillation then transfers the teacher representations to a lightweight student during detection. Experiments on four EEG seizure datasets demonstrate the generalizability of ViTexSZ across both subclinical and general seizure detection scenarios, achieving the highest accuracy on all datasets and relative improvements of up to 12.9% over the second-best baselines, showing its effectiveness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 13 of its 22 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
13 of 22 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2018The Temple University Hospital Seizure Detection Corpuscited by 83
- 2024MedualTime: A Dual-Adapter Language Model for Medical Time Series-Text Multimodal Learningcited by 11
- 2024Enhancing Table Recognition with Vision LLMs: A Benchmark and Neighbor-Guided Toolchain Reasonercited by 9
- 2026Decentralized Attention Fails Centralized Signals: Rethinking Transformers for Medical Time Seriescited by 5
- 2025The Case for Cleaner Biosignals: High-fidelity Neural Compressor Enables Transfer from Cleaner iEEG to Noisier EEGcited by 3
- 2025An Automated Classifier of Harmful Brain Activities for Clinical Usage Based on a Vision-Inspired Pre-trained Frameworkcited by 3
- 2026UniPACT: A Multimodal Framework for Prognostic Question Answering on Raw ECG and Structured EHRcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RAICL: Retrieval-Augmented In-Context Learning for Vision-Language-Model Based EEG Seizure Detection
- 2025DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
- 2023Knowledge-Distilled Graph Neural Networks for Personalized Epileptic Seizure Detection
- 2026A Neurosymbolic Framework for Interpretable Skeleton-Based Seizure Detection via Concept-Driven Logical Reasoning
- 2026Multimodal Pretraining for Generalizable EEG Representation Learning
- 2026Explainable Interictal Epileptiform Discharge Detection Method Based on Scalp EEG and Retrieval-Augmented Generation ↗
- 2026Seizure-Semiology-Suite (S3): A Clinically Multimodal Dataset, Benchmark, and Models for Seizure Semiology Understanding
- 2026Efficient EEG Seizure Detection Using INT8 Quantization, Channel Pruning, and Spiking Neural Networks