mlsanityData to 14 Oct 2026

BioKD: Selective Physiology-to-Video Knowledge Distillation via Reliability Gate for Emotion Recognition

arXiv 2608.06023 ↗First posted 6 Aug 2026cs.LGcited by 0

On the map: Knowledge distillation → Multimodal distillation

Abstract (arXiv)

To address the limitations of video-based emotion recognition under ambiguous or socially masked behavioral cues, as well as the poor deployability of physiological signals, this paper proposes a reliability-aware physiology-to-video knowledge distillation framework, termed BioKD. The proposed framework leverages physiological signals as privileged information during training to guide a video-based student model in learning deep affective representations, while relying solely on non-intrusive video inputs at inference time. To cope with the high noise and instability of physiological teacher supervision caused by inter-subject variability, signal artifacts, and temporal inconsistency, BioKD incorporates a sample-wise reliability-aware gating mechanism together with a progressive distillation strategy. By adaptively regulating the strength of knowledge transfer, the framework suppresses negative transfer induced by unreliable physiological supervision and enables more stable cross-modal distillation. Experiments on DEAP and AMIGOS show that BioKD consistently outperforms representative baselines under both trial-wise and subject-wise evaluation protocols for valence and arousal recognition. For example, BioKD achieves 68.01% on DEAP (trial-wise arousal) and 65.29% under the more challenging subject-wise setting, demonstrating improved performance under a subject-independent evaluation setting. Further analyses show that BioKD effectively mitigates overconfident teacher errors and outperforms an entropy-only weighting strategy, confirming the importance of explicitly modeling supervision reliability. In addition, BioKD introduces no additional inference-time overhead relative to the same video student architecture and removes the need for physiological sensing and multimodal synchronization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal distillation, one of 12 directions in Knowledge distillation. Builds on 25 of its 64 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

25 of 64 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversations31 Oct

Other references · 24

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2017On Calibration of Modern Neural Networkscited by 4,960
  3. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  4. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  5. 2020Knowledge Distillation: A Surveycited by 1,603
  6. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  7. 2019When Does Label Smoothing Help?cited by 988
  8. 2019Relational Knowledge Distillationcited by 889
  9. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  10. 2019Improved Knowledge Distillation via Teacher Assistantcited by 573
  11. 2019Similarity-Preserving Knowledge Distillationcited by 516
  12. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 497
12 more
  1. 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 405
  2. 2019Variational Information Distillation for Knowledge Transfercited by 324
  3. 2018Deep Facial Expression Recognition: A Surveycited by 270
  4. 2015Cross Modal Distillation for Supervision Transfercited by 175
  5. 2025A Comprehensive Survey on Knowledge Distillationcited by 51
  6. 2022A Survey on Physiological Signal Based Emotion Recognitioncited by 12
  7. 2023From the Lab to the Wild: Affect Modeling via Privileged Informationcited by 12
  8. 2024Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learningcited by 11
  9. 2025Hierarchical MoE: Continuous Multimodal Emotion Recognition with Incomplete and Asynchronous Inputscited by 4
  10. 2024PHemoNet: A Multimodal Network for Physiological Signalscited by 2
  11. 2025MVP: Multimodal Emotion Recognition based on Video and Physiological Signalscited by 2
  12. 2024Online Multi-level Contrastive Representation Distillation for Cross-Subject fNIRS Emotion Recognitioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition
  2. 2024Bridging Modalities: Knowledge Distillation and Masked Training for Translating Multi-Modal Emotion Recognition to Uni-Modal, Speech-Only Emotion Recognition
  3. 2025VidEmo: Affective-Tree Reasoning for Emotion-Centric Video Foundation Models
  4. 2023A Lightweight Domain Adversarial Neural Network Based on Knowledge Distillation for EEG-based Cross-subject Emotion Recognition
  5. 2021Iterative Distillation for Better Uncertainty Estimates in Multitask Emotion Recognition
  6. 2026AMRD: Adaptive Multi-Teacher Relational Distillation for Lightweight Speech Emotion Recognition
  7. 2024Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transport
  8. 2021Distilling EEG Representations via Capsules for Affective Computing