Sketch It Out: Exploring Label-Free Structural Cues for Multimodal Gait Recognition
Not on the map. Why?
Abstract (arXiv)
Gait recognition is a non-intrusive biometric technique for security applications, yet existing studies are dominated by silhouette- and parsing-based representations. Silhouettes are sparse and miss internal structural details, limiting discriminability. Parsing enriches silhouettes with part-level structures, but relies heavily on upstream human parsers (e.g., label granularity and boundary precision), leading to unstable performance across datasets and sometimes even inferior results to silhouettes. We revisit gait representations from a structural perspective and describe a design space defined by edge density and supervision form: silhouettes use sparse boundary edges with weak single-label supervision, while parsing uses denser cues with strong semantic priors. In this space, we identify an underexplored paradigm: dense part-level structure without explicit semantic labels, and introduce SKETCH as a new visual modality for gait recognition. Sketch extracts high-frequency structural cues (e.g., limb articulations and self-occlusion contours) directly from RGB images via edge-based detectors in a label-free manner. We further show that label-guided parsing and label-free sketch are semantically decoupled and structurally complementary. Based on this, we propose SKETCHGAIT, a hierarchically disentangled multi-modal framework with two independent streams for modality-specific learning and a lightweight early-stage fusion branch to capture structural complementarity. Extensive experiments on SUSTech1K and CCPG validate the proposed modality and framework: SketchGait achieves 92.9% Rank-1 on SUSTech1K and 93.1% mean Rank-1 on CCPG.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
20 of 34 references.
References · 20
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015Holistically-Nested Edge Detectioncited by 590
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2016Richer Convolutional Features for Edge Detectioncited by 141
- 2021GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognitioncited by 114
- 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 113
- 2019Dense Extreme Inception Network: Towards a Robust CNN Model for Edge Detectioncited by 104
- 2019Bi-Directional Cascade Network for Perceptual Edge Detectioncited by 71
- 2023Exploring Deep Models for Practical Gait Recognitioncited by 44
- 2023Parsing is All You Need for Accurate Gait Recognition in the Wildcited by 32
- 2023Tiny and Efficient Model for the Edge Detection Generalizationcited by 28
8 more
- 2021CDGNet: Class Distribution Guided Network for Human Parsingcited by 26
- 2022GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognitioncited by 25
- 2023Deep Learning Technique for Human Parsing: A Survey and Outlookcited by 18
- 2022Gait Recognition in Large-scale Free Environment via Single LiDARcited by 16
- 2024Exploring More from Multiple Gait Modalities for Human Identificationcited by 12
- 2023GaitPT: Skeletons Are All You Need For Gait Recognitioncited by 11
- 2025PSGait: Gait Recognition using Parsing Skeletoncited by 8
- 2023TriGait: Aligning and Fusing Skeleton and Silhouette Gait Data via a Tri-Branch Networkcited by 3
Built on by
Not cited yet.