FedL2T: Personalized Federated Learning with Two-Teacher Distillation for Seizure Prediction
Not on the map. Why?
Abstract (arXiv)
The training of deep learning models in seizure prediction requires large amounts of Electroencephalogram (EEG) data. However, acquiring sufficient labeled EEG data is difficult due to annotation costs and privacy constraints. Federated Learning (FL) enables privacy-preserving collaborative training by sharing model updates instead of raw data. However, due to the inherent inter-patient variability in real-world scenarios, existing FL-based seizure prediction methods struggle to achieve robust performance under heterogeneous client settings. To address this challenge, we propose FedL2T, a personalized federated learning framework that leverages a novel two-teacher knowledge distillation strategy to generate superior personalized models for each client. Specifically, each client simultaneously learns from a globally aggregated model and a dynamically assigned peer model, promoting more direct and enriched knowledge exchange. To ensure reliable knowledge transfer, FedL2T employs an adaptive multi-level distillation strategy that aligns both prediction outputs and intermediate feature representations based on task confidence. In addition, a proximal regularization term is introduced to constrain personalized model updates, thereby enhancing training stability. Extensive experiments on two EEG datasets demonstrate that FedL2T consistently outperforms state-of-the-art FL methods, particularly under low-label conditions. Moreover, FedL2T exhibits rapid and stable convergence toward optimal performance, thereby reducing the number of communication rounds and associated overhead. These results underscore the potential of FedL2T as a reliable and personalized solution for seizure prediction in privacy-sensitive healthcare scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
11 of 23 references.
References · 11
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 665
- 2017Deep Mutual Learningcited by 621
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 537
- 2021FedKD: Communication Efficient Federated Learning via Knowledge Distillationcited by 185
- 2022Knowledge Distillation for Federated Learning: a Practical Guidecited by 31
- 2024Federated Model Heterogeneous Matryoshka Representation Learningcited by 21
- 2023PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmarkcited by 16
Built on by
Not cited yet.