FootFormer: Estimating Stability from Visual Input
Not on the map. Why?
Abstract (arXiv)
We propose FootFormer, a cross-modality approach for jointly predicting human motion dynamics directly from visual input. On multiple datasets, FootFormer achieves statistically significantly better or equivalent estimates of foot pressure distributions, foot contact maps, and center of mass (CoM), as compared with existing methods that generate one or two of those measures. Furthermore, FootFormer achieves SOTA performance in estimating stability-predictive components (CoP, CoM, BoS) used in classic kinesiology metrics. Code and data are available at https://github.com/keatonkraiger/Vision-to-Stability.git.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 59 references that are in the map. First posted on arXiv 22 Oct 2025.
Builds on
25 of 59 references.
References · 25
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2016Convolutional Pose Machinescited by 325
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2017Towards Accurate Multi-person Pose Estimation in the Wildcited by 131
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2020Contact and Human Dynamics from Monocular Videocited by 95
- 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 71
13 more
- 2017Multi-Context Attention for Human Pose Estimationcited by 66
- 2015Flowing ConvNets for Human Pose Estimation in Videoscited by 55
- 2019Estimating 3D Motion and Forces of Person-Object Interactions from Monocular Videocited by 48
- 2016PoseTrack: Joint Multi-Person Pose Estimation and Trackingcited by 44
- 2017Thin-Slicing Network: A Deep Structured Model for Pose Estimation in Videoscited by 40
- 2014Articulated Pose Estimation by a Graphical Model with Image Dependent Pairwise Relationscited by 24
- 2024MMVP: A Multimodal MoCap Dataset with Vision and Pressure Sensorscited by 17
- 2022UnderPressure: Deep Learning for Foot Contact Detection, Ground Reaction Force Estimation and Footskate Cleanupcited by 16
- 2020Weakly-supervised Learning of Human Dynamicscited by 13
- 2023GroundLink: A Dataset Unifying Human Body Movement and Ground Reaction Dynamicscited by 13
- 2014MoDeep: A Deep Learning Framework Using Motion Features for Human Pose Estimationcited by 6
- 2022Image-based Stability Quantificationcited by 2
- 2024Deep-Learning Estimation of Weight Distribution Using Joint Kinematics for Lower-Limb Exoskeleton Controlcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.