CGTGait: Collaborative Graph and Transformer for Gait Emotion Recognition
Not on the map. Why?
Abstract (arXiv)
Skeleton-based gait emotion recognition has received significant attention due to its wide-ranging applications. However, existing methods primarily focus on extracting spatial and local temporal motion information, failing to capture long-range temporal representations. In this paper, we propose CGTGait, a novel framework that collaboratively integrates graph convolution and transformers to extract discriminative spatiotemporal features for gait emotion recognition. Specifically, CGTGait consists of multiple CGT blocks, where each block employs graph convolution to capture frame-level spatial topology and the transformer to model global temporal dependencies. Additionally, we introduce a Bidirectional Cross-Stream Fusion (BCSF) module to effectively aggregate posture and motion spatiotemporal features, facilitating the exchange of complementary information between the two streams. We evaluate our method on two widely used datasets, Emotion-Gait and ELMD, demonstrating that our CGTGait achieves state-of-the-art or at least competitive performance while reducing computational complexity by approximately 82.2% (only requiring 0.34G FLOPs) during testing. Code is available at smallhttps://github.com/githubzjj1/CGTGait.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 70 references that are in the map. First posted on arXiv 20 Sep 2025.
Builds on
34 of 70 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
- 2018Deep Facial Expression Recognition: A Surveycited by 269
- 2021I-BERT: Integer-only BERT Quantizationcited by 250
22 more
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2020Spatial Temporal Transformer Network for Skeleton-based Action Recognitioncited by 76
- 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
- 2023Learning Discriminative Representations for Skeleton Based Action Recognitioncited by 62
- 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognitioncited by 46
- 20233Mformer: Multi-order Multi-mode Transformer for Skeletal Action Recognitioncited by 40
- 2019STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaitscited by 36
- 2022Hypergraph Transformer for Skeleton-based Action Recognitioncited by 36
- 2024LLMs are Good Action Recognizerscited by 36
- 2023Video-GroundingDINO: Towards Open-Vocabulary Spatio-Temporal Video Groundingcited by 32
- 2020ProxEmo: Gait-based Emotion Learning and Multi-view Proxemic Fusion for Socially-Aware Robot Navigationcited by 17
- 2024Frequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed Transformercited by 15
- 2024MacDiff: Unified Skeleton Modeling with Masked Conditional Diffusioncited by 15
- 2019Identifying Emotions from Walking using Affective and Deep Featurescited by 12
- 2023CAST: Cross-Attention in Space and Time for Video Action Recognitioncited by 12
- 2020Emotion Recognition From Gait Analyses: Current Research and Future Directionscited by 11
- 2023InfoGCN++: Learning Representation by Predicting the Future for Online Human Skeleton-based Action Recognitioncited by 11
- 2019Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mappingcited by 10
- 2021TNTC: two-stream network with transformer-based complementarity for gait-based emotion recognitioncited by 6
- 2022MSA-GCN:Multiscale Adaptive Graph Convolution Network for Gait Emotion Recognitioncited by 6
- 2022HICEM: A High-Coverage Emotion Model for Artificial Emotional Intelligencecited by 5
- 2024ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videoscited by 3
Built on by
Not cited yet.