On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognition
Not on the map. Why?
Abstract (arXiv)
Gait recognition from video streams is a challenging problem in computer vision biometrics due to the subtle differences between gaits and numerous confounding factors. Recent advancements in self-supervised pretraining have led to the development of robust gait recognition models that are invariant to walking covariates. While neural scaling laws have transformed model development in other domains by linking performance to data, model size, and compute, their applicability to gait remains unexplored. In this work, we conduct the first empirical study scaling on skeleton-based self-supervised gait recognition to quantify the effect of data quantity, model size and compute on downstream gait recognition performance. We pretrain multiple variants of GaitPT - a transformer-based architecture - on a dataset of 2.7 million walking sequences collected in the wild. We evaluate zero-shot performance across four benchmark datasets to derive scaling laws for data, model size, and compute. Our findings demonstrate predictable power-law improvements in performance with increased scale and confirm that data and compute scaling significantly influence downstream accuracy. We further isolate architectural contributions by comparing GaitPT with GaitFormer under controlled compute budgets. These results provide practical insights into resource allocation and performance estimation for real-world gait recognition systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 10 Apr 2025.
Builds on
40 of 57 references.
References · 40
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2020GLU Variants Improve Transformercited by 1,804
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
28 more
- 2023Scaling Data-Constrained Language Modelscited by 403
- 2022Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfercited by 288
- 2021Scaling Laws for Transfercited by 272
- 2019A Constructive Prediction of the Generalization Error Across Scalescited by 210
- 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
- 2018Spreading vectors for similarity searchcited by 118
- 2021GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognitioncited by 115
- 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 114
- 2022Broken Neural Scaling Lawscited by 109
- 2023Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Designcited by 89
- 2021GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Setcited by 57
- 2022Data Scaling Laws in NMT: The Effect of Noise and Architecturecited by 55
- 2022On Data Scaling in Masked Image Modelingcited by 46
- 2019On Learning Disentangled Representations for Gait Recognitioncited by 43
- 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 41
- 2023GPGait: Generalized Pose-based Gait Recognitioncited by 40
- 2021Scaling Law for Recommendation Models: Towards General-purpose User Representationscited by 26
- 2022GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognitioncited by 26
- 2022Learning Gait Representation from Massive Unlabelled Walking Videos: A Benchmarkcited by 25
- 2023Cross-Covariate Gait Recognition: A Benchmarkcited by 22
- 2023GaitPT: Skeletons Are All You Need For Gait Recognitioncited by 11
- 2023PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gaitcited by 10
- 2021WildGait: Learning Gait Representations from Raw Surveillance Streamscited by 9
- 2023GaitFormer: Learning Gait Representations with Noisy Multi-Task Learningcited by 7
- 2021Simple online and real-time tracking with occlusion handlingcited by 4
- 2024The Paradox of Motion: Evidence for Spurious Correlations in Skeleton-based Gait Recognition Modelscited by 3
- 2023GaitMorph: Transforming Gait by Optimally Transporting Discrete Codescited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.