mlsanityData to 7 Oct 2026

MuDD: A Multimodal Deception Detection Dataset and GSR-Guided Progressive Distillation for Non-Contact Deception Detection

arXiv 2603.26064 ↗First posted 27 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Non-contact automatic deception detection remains challenging because visual and auditory deception cues often lack stable cross-subject patterns. In contrast, galvanic skin response (GSR) provides more reliable physiological cues and has been widely used in contact-based deception detection. In this work, we leverage stable deception-related knowledge in GSR to guide representation learning in non-contact modalities through cross-modal knowledge distillation. A key obstacle, however, is the lack of a suitable dataset for this setting. To address this, we introduce MuDD, a large-scale Multimodal Deception Detection dataset containing recordings from 130 participants over 690 minutes. In addition to video, audio, and GSR, MuDD also provides Photoplethysmography, heart rate, and personality traits, supporting broader scientific studies of deception. Based on this dataset, we propose GSR-guided Progressive Distillation (GPD), a cross-modal distillation framework for mitigating the negative transfer caused by the large modality mismatch between GSR and non-contact signals. The core innovation of GPD is the integration of progressive feature-level and digit-level distillation with dynamic routing, which allows the model to adaptively determine how teacher knowledge should be transferred during training, leading to more stable cross-modal knowledge transfer. Extensive experiments and visualizations show that GPD outperforms existing methods and achieves state-of-the-art performance on both deception detection and concealed-digit identification.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 47 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

19 of 47 references.

References · 19

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  3. 2020Knowledge Distillation: A Surveycited by 1,578
  4. 2019Relational Knowledge Distillationcited by 873
  5. 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
  6. 2019Correlation Congruence for Knowledge Distillationcited by 280
  7. 2015Cross Modal Distillation for Supervision Transfercited by 173
  8. 2019ASR is all you need: cross-modal distillation for lip readingcited by 85
  9. 2022The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillationcited by 44
  10. 2024Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalitiescited by 32
  11. 2022XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learningcited by 30
  12. 2024Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transportcited by 15
7 more
  1. 2018Face-Focused Cross-Stream Network for Deception Detection in Videoscited by 14
  2. 2023Audio-Visual Deception Detection: DOLOS Dataset and Parameter-Efficient Crossmodal Learningcited by 14
  3. 2024MDPE: A Multimodal Deception Dataset with Personality and Emotional Characteristicscited by 7
  4. 2025MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillationcited by 5
  5. 2024A Generalization Theory of Cross-Modality Distillation with Contrastive Learningcited by 1
  6. 2025Asymmetric Cross-Modal Knowledge Distillation: Bridging Modalities with Weak Semantic Consistencycited by 1
  7. 2026GenLie: A Global-Enhanced Lie Detection Network under Sparsity and Semantic Interferencecited by 1

Built on by

Not cited yet.