Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants
Not on the map. Why?
Abstract (arXiv)
arly identification of motor impairment in infancy relies on expert visual assessment of spontaneous movement, motivating the development of automated, objective alternatives. One promising approach is using computer vision, which benefits from high quality pose estimation from video. In this study, we systematically evaluated three state-of-the-art pose estimation frameworks (MeTRAbs-ACAE, SAM 3D Body, and Sapiens) on 100 videos over 13 sessions of 8 infants recorded with a multi-view markerless motion capture system. We quantified keypoint detection accuracy using reprojection error, geometric consistency, and Procrustes-aligned 3D position error, and demonstrated proof-of-concept for fitting an inverse kinematic framework to infant data. While Sapiens achieved the lowest reprojection error and highest geometric consistency of the methods evaluated (22.8 pixels and 0.82, respectively), SAM 3D Body provided the most comprehensive 3D information for kinematic reconstruction with Procrustes-aligned position errors of 19 to 28 mm. We demonstrate in a case comparison example that biomechanical models fit to SAM 3D estimates distinguish representative movement patterns in infants related to motor development, as identified by a clinical expert. Together, these findings highlight both the promise and current limitations of 3D pose estimation for infant biomechanics and establish preliminary groundwork for scalable, video-based assessment of early motor development.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
16 of 37 references.
References · 16
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 69
- 2020MoVi: A Large Multipurpose Motion and Video Datasetcited by 58
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
- 2018Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequencescited by 19
- 2024Differentiable Biomechanics Unlocks Opportunities for Markerless Motion Capturecited by 18
- 2023Improved Trajectory Reconstruction for Markerless Pose Estimationcited by 12
- 2022On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimationcited by 10
- 2023Markerless Motion Capture and Biomechanical Analysis Pipelinecited by 10
- 2025MHR: Momentum Human Rigcited by 9
- 2025Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphonecited by 8
- 2024Fusing uncalibrated IMUs and handheld smartphone video to reconstruct knee kinematicscited by 6
4 more
- 2024Automatic infant 2D pose estimation from videos: comparing seven deep neural network methodscited by 6
- 2026Monocular Biomechanical Tracking of Fingers with Inverse Kinematics to Foundation Modelscited by 5
- 2024Comparison of marker-less 2D image-based methods for infant pose estimationcited by 2
- 2023Strengths and Weaknesses of 3D Pose Estimation and Inertial Motion Capture System for Movement Therapycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.