mlsanityData to 14 Oct 2026

Database-Agnostic Gait Enrollment using SetTransformers

arXiv 2505.02815 ↗First posted 5 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Gait recognition has emerged as a powerful tool for unobtrusive and long-range identity analysis, with growing relevance in surveillance and monitoring applications. Although recent advances in deep learning and large-scale datasets have enabled highly accurate recognition under closed-set conditions, real-world deployment demands open-set gait enrollment, which means determining whether a new gait sample corresponds to a known identity or represents a previously unseen individual. In this work, we introduce a transformer-based framework for open-set gait enrollment that is both dataset-agnostic and recognition-architecture-agnostic. Our method leverages a SetTransformer to make enrollment decisions based on the embedding of a probe sample and a context set drawn from the gallery, without requiring task-specific thresholds or retraining for new environments. By decoupling enrollment from the main recognition pipeline, our model is generalized across different datasets, gallery sizes, and identity distributions. We propose an evaluation protocol that uses existing datasets in different ratios of identities and walks per identity. We instantiate our method using skeleton-based gait representations and evaluate it on two benchmark datasets (CASIA-B and PsyMo), using embeddings from three state-of-the-art recognition models (GaitGraph, GaitFormer, and GaitPT). We show that our method is flexible, is able to accurately perform enrollment in different scenarios, and scales better with data compared to traditional approaches. We will make the code and dataset scenarios publicly available.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 5 May 2025.

Builds on

20 of 34 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
  5. 2018GaitSet: Regarding Gait as a Set for Cross-View Gait Recognitioncited by 138
  6. 2021GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognitioncited by 115
  7. 2020Hybrid Models for Open Set Recognitioncited by 109
  8. 2020Stronger, Faster and More Explainable: A Graph Convolutional Baseline for Skeleton-based Action Recognitioncited by 91
  9. 2015DeepID3: Face Recognition with Very Deep Neural Networkscited by 62
  10. 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 41
  11. 2017Toward Open-Set Face Recognitioncited by 29
  12. 2019P-ODN: Prototype based Open Deep Network for Open Set Recognitioncited by 28
8 more
  1. 2022GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognitioncited by 26
  2. 2023GaitPT: Skeletons Are All You Need For Gait Recognitioncited by 11
  3. 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
  4. 2023PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gaitcited by 10
  5. 2021WildGait: Learning Gait Representations from Raw Surveillance Streamscited by 9
  6. 2023GaitFormer: Learning Gait Representations with Noisy Multi-Task Learningcited by 7
  7. 2019Unknown Identity Rejection Loss: Utilizing Unlabeled Data for Face Recognitioncited by 3
  8. 2025Open-Set Gait Recognition from Sparse mmWave Radar Point Cloudscited by 1

Built on by

Not cited yet.