Deep state-space modeling for explainable representation, analysis, and generation of professional human poses
Not on the map. Why?
Abstract (arXiv)
The analysis of human movements has been extensively studied due to its wide variety of practical applications, such as human-robot interaction, human learning applications, or clinical diagnosis. Nevertheless, the state-of-the-art still faces scientific challenges when modeling human movements. To begin, new models must account for the stochasticity of human movement and the physical structure of the human body in order to accurately predict the evolution of full-body motion descriptors over time. Second, while utilizing deep learning algorithms, their explainability in terms of body posture predictions needs to be improved as they lack comprehensible representations of human movement. This paper addresses these challenges by introducing three novel methods for creating explainable representations of human movement. In this study, human body movement is formulated as a state-space model adhering to the structure of the Gesture Operational Model (GOM), whose parameters are estimated through the application of deep learning and statistical algorithms. The trained models are used for the full-body dexterity analysis of expert professionals, in which dynamic associations between body joints are identified, and for generating artificially professional movements.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 54 references that are in the map. First posted on arXiv 13 Apr 2023.
Builds on
17 of 54 references.
References · 17
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2019Human Motion Trajectory Prediction: A Surveycited by 232
- 2016Sequential Neural Models with Stochastic Layerscited by 115
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2020MoVi: A Large Multipurpose Motion and Video Datasetcited by 58
5 more
- 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 47
- 2021Multi-level Motion Attention for Human Motion Predictioncited by 35
- 2020DeepSSM: Deep State-Space Model for 3D Human Motion Predictioncited by 3
- 2021How Can I Swing Like Pro?: Golf Swing Analysis Tool for Self Trainingcited by 1
- 2023Motion Capture Benchmark of Real Industrial Tasks and Traditional Crafts for Human Movement Analysiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capture
- 2024Homogeneous Dynamics Space for Heterogeneous Humans
- 2025From Actions to Kinesics: Extracting Human Psychological States through Bodily Movements
- 2024HumMUSS: Human Motion Understanding using State Space Models
- 2025Human sensory-musculoskeletal modeling and control of whole-body movements
- 2026FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusion
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction
- 2025SMamDiff: Spatial Mamba for Stochastic Human Motion Prediction