mlsanityData to 14 Oct 2026

MoME: Estimating Psychological Traits from Gait with Multi-Stage Mixture of Movement Experts

arXiv 2510.04654 ↗First posted 6 Oct 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Gait encodes rich biometric and behavioural information, yet leveraging the manner of walking to infer psychological traits remains a challenging and underexplored problem. We introduce a hierarchical Multi-Stage Mixture of Movement Experts (MoME) architecture for multi-task prediction of psychological attributes from gait sequences represented as 2D poses. MoME processes the walking cycle in four stages of movement complexity, employing lightweight expert models to extract spatio-temporal features and task-specific gating modules to adaptively weight experts across traits and stages. Evaluated on the PsyMo benchmark covering 17 psychological traits, our method outperforms state-of-the-art gait analysis models, achieving a 37.47% weighted F1 score at the run level and 44.6% at the subject level. Our experiments show that integrating auxiliary tasks such as identity recognition, gender prediction, and BMI estimation further improves psychological trait estimation. Our findings demonstrate the viability of multi-task gait-based learning for psychological trait estimation and provide a foundation for future research on movement-informed psychological inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 70 references that are in the map. First posted on arXiv 6 Oct 2025.

Builds on

30 of 70 references.

References · 30

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2023Segment Anythingcited by 8,234
  3. 2017Mask R-CNNcited by 7,277
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  6. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  7. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
  8. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
  9. 2013Learning Factored Representations in a Deep Mixture of Expertscited by 278
  10. 2018GaitSet: Regarding Gait as a Set for Cross-View Gait Recognitioncited by 138
  11. 2021GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognitioncited by 115
  12. 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 114
18 more
  1. 2020Stronger, Faster and More Explainable: A Graph Convolutional Baseline for Skeleton-based Action Recognitioncited by 91
  2. 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
  3. 2021GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Setcited by 57
  4. 2022Towards a Deeper Understanding of Skeleton-based Gait Recognitioncited by 56
  5. 2018A Modulation Module for Multi-task Learning with Applications in Image Retrievalcited by 49
  6. 2023Exploring Deep Models for Practical Gait Recognitioncited by 46
  7. 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 41
  8. 2023DyGait: Exploiting Dynamic Representations for High-performance Gait Recognitioncited by 35
  9. 2022GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognitioncited by 26
  10. 2020JointsGait:A model-based Gait Recognition Method based on Gait Graph Convolutional Networks and Joints Relationship Pyramid Mappingcited by 22
  11. 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
  12. 2024OpenGait: A Comprehensive Benchmark Study for Gait Recognition towards Better Practicalitycited by 15
  13. 2023GaitPT: Skeletons Are All You Need For Gait Recognitioncited by 11
  14. 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
  15. 2023PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gaitcited by 10
  16. 2021WildGait: Learning Gait Representations from Raw Surveillance Streamscited by 9
  17. 2023GaitFormer: Learning Gait Representations with Noisy Multi-Task Learningcited by 7
  18. 2025On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognitioncited by 2

Built on by

Not cited yet.