GaitKD: A Universal Decoupled Distillation Framework for Efficient Gait Recognition
Not on the map. Why?
Abstract (arXiv)
Gait recognition is an attractive biometric modality for long-range and contact-free identification, but high-performing gait models often rely on deep and computationally expensive architectures that are difficult to deploy in practice. Knowledge distillation (KD) offers a natural way to transfer knowledge from a powerful teacher to an efficient student; however, standard KD is often less effective for part-structured gait models, where supervision is formed from both part-wise classification logits and part-wise retrieval embeddings. In this paper, we propose GaitKD, a distillation framework that decouples gait knowledge transfer into two complementary components: decision-level distillation and boundary-level distillation. Specifically, GaitKD aligns the teacher and student through part-calibrated logit distillation to transfer inter-class decision relations, while preserving the teacher-induced partitioning of the embedding space through an activation-boundary objective instead of direct feature regression. With a simple aligned part-wise design, GaitKD supports heterogeneous teacher-student gait models without introducing additional inference cost. Experimental results across multiple gait recognition benchmarks and teacher-student configurations show consistent improvements over strong gait baselines. Our study demonstrates that the two transfer components are complementary, and boundary-preserving distillation provides more stable performance than direct feature regression. Source code is available at https://github.com/liyiersan/GaitKD/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
27 of 43 references.
References · 27
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2019Relational Knowledge Distillationcited by 873
- 2019Contrastive Representation Distillationcited by 734
- 2022Decoupled Knowledge Distillationcited by 380
- 2019A Comprehensive Overhaul of Feature Distillationcited by 341
- 2018Paraphrasing Complex Network: Network Compression via Factor Transfercited by 255
- 2018Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neuronscited by 235
- 2018GaitSet: Regarding Gait as a Set for Cross-View Gait Recognitioncited by 137
- 2022Cross-Image Relational Knowledge Distillation for Semantic Segmentationcited by 117
- 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 113
15 more
- 2024Logit Standardization in Knowledge Distillationcited by 101
- 2022OpenGait: Revisiting Gait Recognition Toward Better Practicalitycited by 85
- 2021Deep Gait Recognition: A Surveycited by 54
- 2022LidarGait: Benchmarking 3D Gait Recognition with Point Cloudscited by 54
- 2022A Comprehensive Survey on Deep Gait Recognition: Algorithms, Datasets and Challengescited by 45
- 2021Hierarchical Self-supervised Augmented Knowledge Distillationcited by 44
- 2024BigGait: Learning Gait Representation You Want by Large Vision Modelscited by 44
- 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 40
- 2022Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognitioncited by 36
- 2019Preparing Lessons: Improve Knowledge Distillation with Better Supervisioncited by 27
- 2022GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognitioncited by 25
- 2024OpenGait: A Comprehensive Benchmark Study for Gait Recognition towards Better Practicalitycited by 15
- 2025On Denoising Walking Videos for Gait Recognitioncited by 14
- 2023GaitContour: Efficient Gait Recognition based on a Contour-Pose Representationcited by 8
- 2024AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognitioncited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.