mlsanityData to 7 Oct 2026

CGTGait: Collaborative Graph and Transformer for Gait Emotion Recognition

arXiv 2509.16623 ↗First posted 20 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Skeleton-based gait emotion recognition has received significant attention due to its wide-ranging applications. However, existing methods primarily focus on extracting spatial and local temporal motion information, failing to capture long-range temporal representations. In this paper, we propose CGTGait, a novel framework that collaboratively integrates graph convolution and transformers to extract discriminative spatiotemporal features for gait emotion recognition. Specifically, CGTGait consists of multiple CGT blocks, where each block employs graph convolution to capture frame-level spatial topology and the transformer to model global temporal dependencies. Additionally, we introduce a Bidirectional Cross-Stream Fusion (BCSF) module to effectively aggregate posture and motion spatiotemporal features, facilitating the exchange of complementary information between the two streams. We evaluate our method on two widely used datasets, Emotion-Gait and ELMD, demonstrating that our CGTGait achieves state-of-the-art or at least competitive performance while reducing computational complexity by approximately 82.2% (only requiring 0.34G FLOPs) during testing. Code is available at smallhttps://github.com/githubzjj1/CGTGait.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 70 references that are in the map. First posted on arXiv 20 Sep 2025.

Builds on

34 of 70 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  9. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  10. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
  11. 2018Deep Facial Expression Recognition: A Surveycited by 269
  12. 2021I-BERT: Integer-only BERT Quantizationcited by 250
22 more
  1. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  2. 2020Spatial Temporal Transformer Network for Skeleton-based Action Recognitioncited by 76
  3. 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
  4. 2023Learning Discriminative Representations for Skeleton Based Action Recognitioncited by 62
  5. 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognitioncited by 46
  6. 20233Mformer: Multi-order Multi-mode Transformer for Skeletal Action Recognitioncited by 40
  7. 2019STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaitscited by 36
  8. 2022Hypergraph Transformer for Skeleton-based Action Recognitioncited by 36
  9. 2024LLMs are Good Action Recognizerscited by 36
  10. 2023Video-GroundingDINO: Towards Open-Vocabulary Spatio-Temporal Video Groundingcited by 32
  11. 2020ProxEmo: Gait-based Emotion Learning and Multi-view Proxemic Fusion for Socially-Aware Robot Navigationcited by 17
  12. 2024Frequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed Transformercited by 15
  13. 2024MacDiff: Unified Skeleton Modeling with Masked Conditional Diffusioncited by 15
  14. 2019Identifying Emotions from Walking using Affective and Deep Featurescited by 12
  15. 2023CAST: Cross-Attention in Space and Time for Video Action Recognitioncited by 12
  16. 2020Emotion Recognition From Gait Analyses: Current Research and Future Directionscited by 11
  17. 2023InfoGCN++: Learning Representation by Predicting the Future for Online Human Skeleton-based Action Recognitioncited by 11
  18. 2019Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mappingcited by 10
  19. 2021TNTC: two-stream network with transformer-based complementarity for gait-based emotion recognitioncited by 6
  20. 2022MSA-GCN:Multiscale Adaptive Graph Convolution Network for Gait Emotion Recognitioncited by 6
  21. 2022HICEM: A High-Coverage Emotion Model for Artificial Emotional Intelligencecited by 5
  22. 2024ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videoscited by 3

Built on by

Not cited yet.