Text-guided Feature Disentanglement for Cross-modal Gait Recognition
Not on the map. Why?
Abstract (arXiv)
Gait recognition is a biometric technique that identifies individuals based on their walking patterns, offering advantages in long-range, non-intrusive scenarios. However, real-world scenarios often involve heterogeneous sensing modalities such as LiDAR and RGB cameras, making LiDAR-Camera Cross-modal Gait recognition (LCCGR) a critical yet challenging task due to the substantial modality gap between 2D videos and 3D point cloud sequences. To address this challenge, we propose TCFDNet, a Text-guided Cross-modal Feature Disentanglement Network, which leverages modality-aware textual priors as semantic anchors to guide the learning of disentangled modality-shared representations. Specifically, we construct a Gait Modality Text Dictionary (GMTD) using large language models to generate rich semantic descriptions of gait across modalities and viewpoints. A CLIP-based Multi-grained Feature Encoder then aligns visual and textual features within a unified vision-language space. Furthermore, the Text-guided Feature Disentanglement (TFD) module selects the topk matched textual descriptions to reconstruct modality-specific representations and derive modality-shared features via residual decomposition and orthogonality constraints. To mitigate the fragility of the disentangled shared features, we propose a Feature Stability Enhancement (FSE) module, which models spatial and channel-wise correlations to improve feature robustness. In addition, a cross-modal patch exchange strategy is introduced to further improve generalization. Extensive experiments on SUSTech1K and FreeGait datasets demonstrate that TCFDNet achieves new state-of-the-art results and validate the effectiveness of the proposed modules.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
31 of 49 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Qwen Technical Reportcited by 3,273
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2018GaitSet: Regarding Gait as a Set for Cross-View Gait Recognitioncited by 137
- 2020Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregationcited by 120
- 2021GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognitioncited by 114
- 2022OpenGait: Revisiting Gait Recognition Toward Better Practicalitycited by 85
- 2021GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Setcited by 57
- 2022LidarGait: Benchmarking 3D Gait Recognition with Point Cloudscited by 54
19 more
- 2022A Comprehensive Survey on Deep Gait Recognition: Algorithms, Datasets and Challengescited by 45
- 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 40
- 2023GPGait: Generalized Pose-based Gait Recognitioncited by 39
- 2024L4DR: LiDAR-4DRadar Fusion for Weather-Robust 3D Object Detectioncited by 32
- 2021Where and What? Examining Interpretable Disentangled Representationscited by 27
- 2023Modality Unifying Network for Visible-Infrared Person Re-Identificationcited by 27
- 2024Multi-Memory Matching for Unsupervised Visible-Infrared Person Re-Identificationcited by 27
- 2024Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identificationcited by 24
- 2020ICAM: Interpretable Classification via Disentangled Representations and Feature Attribution Mappingcited by 20
- 2024V2X-R: Cooperative LiDAR-4D Radar Fusion with Denoising Diffusion for 3D Object Detectioncited by 18
- 2022Gait Recognition in Large-scale Free Environment via Single LiDARcited by 16
- 2025On Denoising Walking Videos for Gait Recognitioncited by 14
- 2023A Multi-Stage Adaptive Feature Fusion Neural Network for Multimodal Gait Recognitioncited by 12
- 2024RoDLA: Benchmarking the Robustness of Document Layout Analysis Modelscited by 12
- 2024Exploring More from Multiple Gait Modalities for Human Identificationcited by 12
- 2024Camera-LiDAR Cross-modality Gait Recognitioncited by 11
- 2024Cross-Modality Gait Recognition: Bridging LiDAR and Camera Modalities for Human Identificationcited by 10
- 2023GaitRef: Gait Recognition with Refined Sequential Skeletonscited by 9
- 2023Visible-Infrared Person Re-Identification via Patch-Mixed Cross-Modality Learningcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.