Lightweight Facial Landmark Detection in Thermal Images via Multi-Level Cross-Modal Knowledge Transfer
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
Facial Landmark Detection (FLD) in thermal imagery is critical for applications in challenging lighting conditions, but it is hampered by the lack of rich visual cues. Conventional cross-modal solutions, like feature fusion or image translation from RGB data, are often computationally expensive or introduce structural artifacts, limiting their practical deployment. To address this, we propose Multi-Level Cross-Modal Knowledge Distillation (MLCM-KD), a novel framework that decouples high-fidelity RGB-to-thermal knowledge transfer from model compression to create both accurate and efficient thermal FLD models. A central challenge during knowledge transfer is the profound modality gap between RGB and thermal data, where traditional unidirectional distillation fails to enforce semantic consistency across disparate feature spaces. To overcome this, we introduce Dual-Injected Knowledge Distillation (DIKD), a bidirectional mechanism designed specifically for this task. DIKD establishes a connection between modalities: it not only guides the thermal student with rich RGB features but also validates the student's learned representations by feeding them back into the frozen teacher's prediction head. This closed-loop supervision forces the student to learn modality-invariant features that are semantically aligned with the teacher, ensuring a robust and profound knowledge transfer. Experiments show that our approach sets a new state-of-the-art on public thermal FLD benchmarks, notably outperforming previous methods while drastically reducing computational overhead.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 23 of its 43 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
23 of 43 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2016Convolutional Pose Machinescited by 325
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2020Whole-Body Human Pose Estimation in the Wildcited by 178
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2019Distribution-Aware Coordinate Representation for Human Pose Estimationcited by 165
- 2017Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networkscited by 109
11 more
- 2021SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimationcited by 68
- 2018Facial Landmark Detection: a Literature Surveycited by 63
- 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimationcited by 34
- 2021ViPNAS: Efficient Video Pose Estimation via Neural Architecture Searchcited by 26
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 19
- 2021Fast Facial Landmark Detection and Applications: A Surveycited by 18
- 2023RGB-D And Thermal Sensor Fusion: A Systematic Literature Reviewcited by 13
- 2024T-FAKE: Synthesizing Thermal Images for Facial Landmarkingcited by 7
- 2023Automatic Interaction and Activity Recognition from Videos of Human Manual Demonstrations with Application to Anomaly Detectioncited by 3
- 2013Infrared face recognition: a literature reviewcited by 1
- 2025Graph-based Online Monitoring of Train Driver States via Facial and Skeletal Featurescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Thermal-Det: Language-Guided Cross-Modal Distillation for Open-Vocabulary Thermal Object Detection
- 2024Breaking Modality Gap in RGBT Tracking: Coupled Knowledge Distillation
- 2024Improving Facial Landmark Detection Accuracy and Efficiency with Knowledge Distillation
- 2025Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation
- 2026FreqKD: Frequency-Decoupled Cross-Modal Knowledge Distillation for Infrared Object Detection
- 2025SARTM: Segment Any RGB Thermal Model with Language aided Distillation
- 2021Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networks
- 2023Complementary Random Masking for RGB-Thermal Semantic Segmentation