mlsanityData to 7 Oct 2026

GaitKD: A Universal Decoupled Distillation Framework for Efficient Gait Recognition

arXiv 2604.26255 ↗First posted 29 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Gait recognition is an attractive biometric modality for long-range and contact-free identification, but high-performing gait models often rely on deep and computationally expensive architectures that are difficult to deploy in practice. Knowledge distillation (KD) offers a natural way to transfer knowledge from a powerful teacher to an efficient student; however, standard KD is often less effective for part-structured gait models, where supervision is formed from both part-wise classification logits and part-wise retrieval embeddings. In this paper, we propose GaitKD, a distillation framework that decouples gait knowledge transfer into two complementary components: decision-level distillation and boundary-level distillation. Specifically, GaitKD aligns the teacher and student through part-calibrated logit distillation to transfer inter-class decision relations, while preserving the teacher-induced partitioning of the embedding space through an activation-boundary objective instead of direct feature regression. With a simple aligned part-wise design, GaitKD supports heterogeneous teacher-student gait models without introducing additional inference cost. Experimental results across multiple gait recognition benchmarks and teacher-student configurations show consistent improvements over strong gait baselines. Our study demonstrates that the two transfer components are complementary, and boundary-preserving distillation provides more stable performance than direct feature regression. Source code is available at https://github.com/liyiersan/GaitKD/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 29 Apr 2026.

Builds on

27 of 43 references.

References · 27

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  3. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  4. 2019Relational Knowledge Distillationcited by 873
  5. 2019Contrastive Representation Distillationcited by 734
  6. 2022Decoupled Knowledge Distillationcited by 380
  7. 2019A Comprehensive Overhaul of Feature Distillationcited by 341
  8. 2018Paraphrasing Complex Network: Network Compression via Factor Transfercited by 255
  9. 2018Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neuronscited by 235
  10. 2018GaitSet: Regarding Gait as a Set for Cross-View Gait Recognitioncited by 137
  11. 2022Cross-Image Relational Knowledge Distillation for Semantic Segmentationcited by 117
  12. 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 113
15 more
  1. 2024Logit Standardization in Knowledge Distillationcited by 101
  2. 2022OpenGait: Revisiting Gait Recognition Toward Better Practicalitycited by 85
  3. 2021Deep Gait Recognition: A Surveycited by 54
  4. 2022LidarGait: Benchmarking 3D Gait Recognition with Point Cloudscited by 54
  5. 2022A Comprehensive Survey on Deep Gait Recognition: Algorithms, Datasets and Challengescited by 45
  6. 2021Hierarchical Self-supervised Augmented Knowledge Distillationcited by 44
  7. 2024BigGait: Learning Gait Representation You Want by Large Vision Modelscited by 44
  8. 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 40
  9. 2022Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognitioncited by 36
  10. 2019Preparing Lessons: Improve Knowledge Distillation with Better Supervisioncited by 27
  11. 2022GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognitioncited by 25
  12. 2024OpenGait: A Comprehensive Benchmark Study for Gait Recognition towards Better Practicalitycited by 15
  13. 2025On Denoising Walking Videos for Gait Recognitioncited by 14
  14. 2023GaitContour: Efficient Gait Recognition based on a Contour-Pose Representationcited by 8
  15. 2024AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognitioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.