SIMSPINE: A Biomechanics-Aware Simulation Framework for 3D Spine Motion Annotation and Benchmarking
Not on the map. Why?
Abstract (arXiv)
Modeling spinal motion is fundamental to understanding human biomechanics, yet remains underexplored in computer vision due to the spine's complex multi-joint kinematics and the lack of large-scale 3D annotations. We present a biomechanics-aware keypoint simulation framework that augments existing human pose datasets with anatomically consistent 3D spinal keypoints derived from musculoskeletal modeling. Using this framework, we create the first open dataset, named SIMSPINE, which provides sparse vertebra-level 3D spinal annotations for natural full-body motions in indoor multi-camera capture without external restraints. With 2.14 million frames, this enables data-driven learning of vertebral kinematics from subtle posture variations and bridges the gap between musculoskeletal simulation and computer vision. In addition, we release pretrained baselines covering fine-tuned 2D detectors, monocular 3D pose lifting models, and multi-view reconstruction pipelines, establishing a unified benchmark for biomechanically valid spine motion estimation. Specifically, our 2D spine baselines improve the state-of-the-art from 0.63 to 0.80 AUC in controlled environments, and from 0.91 to 0.93 AP for in-the-wild spine tracking. Together, the simulation framework and SIMSPINE dataset advance research in vision-based biomechanics, motion analysis, and digital human modeling by enabling reproducible, anatomically grounded 3D spine estimation under natural conditions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 79 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
15 of 79 references.
References · 15
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
- 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 62
- 2018Iterative fully convolutional neural networks for automatic vertebra segmentation and identificationcited by 25
- 2024Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosiscited by 12
- 2023Human Spine Motion Capture using Perforated Kinesiology Tapecited by 2
- 2025Benchmarking 3D Human Pose Estimation Models under Occlusionscited by 2
3 more
- 2023EVOPOSE: A Recursive Transformer For 3D Human Pose Estimation With Kinematic Structure Priorscited by 1
- 2025Towards Unconstrained 2D Pose Estimation of the Human Spinecited by 1
- 2025PriorFormer: A Transformer for Real-time Monocular 3D Human Pose Estimation with Versatile Geometric Priorscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.