# Parsing is All You Need for Accurate Gait Recognition in the Wild

arXiv: https://arxiv.org/abs/2308.16739 · HTML: https://mlsanity.com/paper/2308.16739/

## Key facts

- Cited by 32 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 58 references that are in the map.
- First posted on arXiv 31 Aug 2023.

## Builds on (most cited first, 21 of 21)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [Pyramid Scene Parsing Network](https://mlsanity.com/paper/1612.01105/) (2016)
- [Deep High-Resolution Representation Learning for Visual Recognition](https://mlsanity.com/paper/1908.07919/) (2019)
- [GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition](https://mlsanity.com/paper/1811.06186/) (2018)
- [Instance-level Human Parsing via Part Grouping Network](https://mlsanity.com/paper/1808.00157/) (2018)
- [Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation](https://mlsanity.com/paper/2011.01461/) (2020)
- [GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognition](https://mlsanity.com/paper/2101.11228/) (2021)
- [Gait Recognition in the Wild with Dense 3D Representations and A Benchmark](https://mlsanity.com/paper/2204.02569/) (2022)
- [Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing](https://mlsanity.com/paper/1703.05446/) (2017)
- [OpenGait: Revisiting Gait Recognition Toward Better Practicality](https://mlsanity.com/paper/2211.06597/) (2022)
- [Gait Recognition via Disentangled Representation Learning](https://mlsanity.com/paper/1904.04925/) (2019)
- [Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspective](https://mlsanity.com/paper/2104.11536/) (2021)
- [Hierarchical Human Parsing with Typed Part-Relation Reasoning](https://mlsanity.com/paper/2003.04845/) (2020)
- [Adaptive Temporal Encoding Network for Video Instance-level Human Parsing](https://mlsanity.com/paper/1808.00661/) (2018)
- [Deep Multi-View Enhancement Hashing for Image Retrieval](https://mlsanity.com/paper/2002.00169/) (2020)
- [CDGNet: Class Distribution Guided Network for Human Parsing](https://mlsanity.com/paper/2111.14173/) (2021)
- [Gait Recognition in the Wild with Multi-hop Temporal Switch](https://mlsanity.com/paper/2209.00355/) (2022)
- [Depth image denoising using nuclear norm and learning graph model](https://mlsanity.com/paper/2008.03741/) (2020)

## Built on by (most cited first, 30 of 32)

- [BigGait: Learning Gait Representation You Want by Large Vision Models](https://mlsanity.com/paper/2402.19122/) (2024)
- [BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Models](https://mlsanity.com/paper/2505.18132/) (2025)
- [OpenGait: A Comprehensive Benchmark Study for Gait Recognition towards Better Practicality](https://mlsanity.com/paper/2405.09138/) (2024)
- [On Denoising Walking Videos for Gait Recognition](https://mlsanity.com/paper/2505.18582/) (2025)
- [Exploring More from Multiple Gait Modalities for Human Identification](https://mlsanity.com/paper/2412.11495/) (2024)
- [It Takes Two: Accurate Gait Recognition in the Wild via Cross-granularity Alignment](https://mlsanity.com/paper/2411.10742/) (2024)
- [GLGait: A Global-Local Temporal Receptive Field Network for Gait Recognition in the Wild](https://mlsanity.com/paper/2408.06834/) (2024)
- [H-MoRe: Learning Human-centric Motion Representation for Action Analysis](https://mlsanity.com/paper/2504.10676/) (2025)
- [Language-Guided and Motion-Aware Gait Representation for Generalizable Recognition](https://mlsanity.com/paper/2601.11931/) (2026)
- [4DPC2hat: Towards Dynamic Point Cloud Understanding with Failure-Aware Bootstrapping](https://mlsanity.com/paper/2602.03890/) (2026)
- [HiH: A Multi-modal Hierarchy in Hierarchy Network for Unconstrained Gait Recognition](https://mlsanity.com/paper/2311.11210/) (2023)
- [SciEducator: Scientific Video Understanding and Educating via Deming-Cycle Multi-Agent System](https://mlsanity.com/paper/2511.17943/) (2025)
- [TrackletGait: A Robust Framework for Gait Recognition in the Wild](https://mlsanity.com/paper/2508.02143/) (2025)
- [Watch Where You Move: Region-aware Dynamic Aggregation and Excitation for Gait Recognition](https://mlsanity.com/paper/2510.16541/) (2025)
- [Silhouette-based Gait Foundation Model](https://mlsanity.com/paper/2512.00691/) (2025)
- [EventGait: Towards Robust Gait Recognition with Event Streams](https://mlsanity.com/paper/2605.22139/) (2026)
- [POSTURE: Pose Guided Unsupervised Domain Adaptation for Human Body Part Segmentation](https://mlsanity.com/paper/2407.03549/) (2024)
- [X-SG2S: Safe and Generalizable Gaussian Splatting with X-dimensional Watermarks](https://mlsanity.com/paper/2502.10475/) (2025)
- [GaitAdapt: Continual Learning for Evolving Gait Recognition](https://mlsanity.com/paper/2508.03375/) (2025)
- [DepthGait: Multi-Scale Cross-Level Feature Fusion of RGB-Derived Depth and Silhouette Sequences for Robust Gait Recognition](https://mlsanity.com/paper/2508.03397/) (2025)
- [Gait Recognition via Collaborating Discriminative and Generative Diffusion Models](https://mlsanity.com/paper/2511.06245/) (2025)
- [Decoding Children's Gait Behavior](https://mlsanity.com/paper/2608.00371/) (2026)
- [Vocabulary-Guided Gait Recognition](https://mlsanity.com/paper/2609.18413/) (2026)
- [HorGait: A Hybrid Model for Accurate Gait Recognition in LiDAR Point Cloud Planar Projections](https://mlsanity.com/paper/2410.08454/) (2024)
- [Unsupervised Domain Adaptation with Dynamic Clustering and Contrastive Refinement for Gait Recognition](https://mlsanity.com/paper/2501.16608/) (2025)
- [RobustGait: Robustness Analysis for Appearance Based Gait Recognition](https://mlsanity.com/paper/2511.13065/) (2025)
- [Learning Geometric Invariance for Gait Recognition](https://mlsanity.com/paper/2601.05604/) (2026)
- [Sketch It Out: Exploring Label-Free Structural Cues for Multimodal Gait Recognition](https://mlsanity.com/paper/2603.05537/) (2026)
- [DVAR: Adversarial Multi-Agent Debate for Video Authenticity Detection](https://mlsanity.com/paper/2604.16987/) (2026)
- [Gait Recognition via Deep Residual Networks and Multi-Branch Feature Fusion](https://mlsanity.com/paper/2604.27353/) (2026)

## Abstract (arXiv)

Binary silhouettes and keypoint-based skeletons have dominated human gait recognition studies for decades since they are easy to extract from video frames. Despite their success in gait recognition for in-the-lab environments, they usually fail in real-world scenarios due to their low information entropy for gait representations. To achieve accurate gait recognition in the wild, this paper presents a novel gait representation, named Gait Parsing Sequence (GPS). GPSs are sequences of fine-grained human segmentation, i.e., human parsing, extracted from video frames, so they have much higher information entropy to encode the shapes and dynamics of fine-grained human parts during walking. Moreover, to effectively explore the capability of the GPS representation, we propose a novel human parsing-based gait recognition framework, named ParsingGait. ParsingGait contains a Convolutional Neural Network (CNN)-based backbone and two light-weighted heads. The first head extracts global semantic features from GPSs, while the other one learns mutual information of part-level features through Graph Convolutional Networks to model the detailed dynamics of human walking. Furthermore, due to the lack of suitable datasets, we build the first parsing-based dataset for gait recognition in the wild, named Gait3D-Parsing, by extending the large-scale and challenging Gait3D dataset. Based on Gait3D-Parsing, we comprehensively evaluate our method and existing gait recognition methods. The experimental results show a significant improvement in accuracy brought by the GPS representation and the superiority of ParsingGait. The code and dataset are available at https://gait3d.github.io/gait3d-parsing-hp .
