mlsanityData to 14 Oct 2026

On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognition

arXiv 2504.07598 ↗First posted 10 Apr 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Gait recognition from video streams is a challenging problem in computer vision biometrics due to the subtle differences between gaits and numerous confounding factors. Recent advancements in self-supervised pretraining have led to the development of robust gait recognition models that are invariant to walking covariates. While neural scaling laws have transformed model development in other domains by linking performance to data, model size, and compute, their applicability to gait remains unexplored. In this work, we conduct the first empirical study scaling on skeleton-based self-supervised gait recognition to quantify the effect of data quantity, model size and compute on downstream gait recognition performance. We pretrain multiple variants of GaitPT - a transformer-based architecture - on a dataset of 2.7 million walking sequences collected in the wild. We evaluate zero-shot performance across four benchmark datasets to derive scaling laws for data, model size, and compute. Our findings demonstrate predictable power-law improvements in performance with increased scale and confirm that data and compute scaling significantly influence downstream accuracy. We further isolate architectural contributions by comparing GaitPT with GaitFormer under controlled compute budgets. These results provide practical insights into resource allocation and performance estimation for real-world gait recognition systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

40 of 57 references.

References · 40

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2020Scaling Laws for Neural Language Modelscited by 6,586
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  9. 2020GLU Variants Improve Transformercited by 1,804
  10. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  11. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
  12. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
28 more
  1. 2023Scaling Data-Constrained Language Modelscited by 403
  2. 2022Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfercited by 288
  3. 2021Scaling Laws for Transfercited by 272
  4. 2019A Constructive Prediction of the Generalization Error Across Scalescited by 210
  5. 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
  6. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
  7. 2018Spreading vectors for similarity searchcited by 118
  8. 2021GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognitioncited by 115
  9. 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 114
  10. 2022Broken Neural Scaling Lawscited by 109
  11. 2023Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Designcited by 89
  12. 2021GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Setcited by 57
  13. 2022Data Scaling Laws in NMT: The Effect of Noise and Architecturecited by 55
  14. 2022On Data Scaling in Masked Image Modelingcited by 46
  15. 2019On Learning Disentangled Representations for Gait Recognitioncited by 43
  16. 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 41
  17. 2023GPGait: Generalized Pose-based Gait Recognitioncited by 40
  18. 2021Scaling Law for Recommendation Models: Towards General-purpose User Representationscited by 26
  19. 2022GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognitioncited by 26
  20. 2022Learning Gait Representation from Massive Unlabelled Walking Videos: A Benchmarkcited by 25
  21. 2023Cross-Covariate Gait Recognition: A Benchmarkcited by 22
  22. 2023GaitPT: Skeletons Are All You Need For Gait Recognitioncited by 11
  23. 2023PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gaitcited by 10
  24. 2021WildGait: Learning Gait Representations from Raw Surveillance Streamscited by 9
  25. 2023GaitFormer: Learning Gait Representations with Noisy Multi-Task Learningcited by 7
  26. 2021Simple online and real-time tracking with occlusion handlingcited by 4
  27. 2024The Paradox of Motion: Evidence for Spurious Correlations in Skeleton-based Gait Recognition Modelscited by 3
  28. 2023GaitMorph: Transforming Gait by Optimally Transporting Discrete Codescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.