Pose-to-Biomechanics: Bridging 3D Human Pose Estimation and Biomechanical Attribute Prediction
Not on the map. Why?
Abstract (arXiv)
Recent progress in 3D human pose estimation has made markerless recovery of skeletal motion increasingly accurate and scalable. However, most pose estimators remain optimized for geometric keypoint accuracy, while many real-world applications in rehabilitation, sports science, ergonomics, and clinical movement analysis require biomechanical quantities that describe how the body moves, loads, and activates. In this work, we propose BioModule, a lightweight plug-in temporal transformer that attaches downstream of any 3D pose estimator and predicts biomechanical attributes from standard 17-joint 3D skeletons. BioModule is estimator-agnostic and requires no modification of the upstream pose model, enabling existing pose estimators to be extended toward physically interpretable motion analysis. To train and evaluate BioModule, we construct a large-scale aligned dataset pairing Human3.6M video and 3D keypoints with the biomechanical label space of Human3.6Mplus. We establish and verify anatomical correspondence between coordinate systems of the two datasets, enabling frame-accurate cross-modal supervision. Using this aligned supervision, BioModule predicts biomechanical quantities. We further benchmark BioModule across seven state-of-the-art 3D pose estimators, providing the first systematic analysis of how upstream pose estimation quality propagates to downstream biomechanical prediction fidelity. The results position BioModule as a compact, modular bridge between vision-based pose estimation and biomechanically meaningful human motion analysis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
27 of 43 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 403
- 2016Convolutional Pose Machinescited by 325
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
15 more
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 20233D Human Pose Estimation via Intuitive Physicscited by 103
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 92
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 82
- 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 64
- 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimationcited by 34
- 2025From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humanscited by 27
- 2025Reconstructing Humans with a Biomechanically Accurate Skeletoncited by 22
- 2025BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videoscited by 16
- 2024PoseMamba: Monocular 3D Human Pose Estimation with Bidirectional Global-Local Spatio-Temporal State Space Modelcited by 15
- 2025TCPFormer: Learning Temporal Correlation with Implicit Pose Proxy for 3D Human Pose Estimationcited by 14
- 2024AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scalecited by 11
- 2024OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanicscited by 7
- 2025SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recoverycited by 2
- 2025SSPINNpose: A Self-Supervised PINN for Inertial Pose and Dynamics Estimationcited by 1
Built on by
Not cited yet.