Intelligent Knee Sleeves: A Real-time Multimodal Dataset for 3D Lower Body Motion Estimation Using Smart Textile
Not on the map. Why?
Abstract (arXiv)
The kinematics of human movements and locomotion are closely linked to the activation and contractions of muscles. To investigate this, we present a multimodal dataset with benchmarks collected using a novel pair of Intelligent Knee Sleeves (Texavie MarsWear Knee Sleeves) for human pose estimation. Our system utilizes synchronized datasets that comprise time-series data from the Knee Sleeves and the corresponding ground truth labels from the visualized motion capture camera system. We employ these to generate 3D human models solely based on the wearable data of individuals performing different activities. We demonstrate the effectiveness of this camera-free system and machine learning algorithms in the assessment of various movements and exercises, including extension to unseen exercises and individuals. The results show an average error of 7.21 degrees across all eight lower body joints when compared to the ground truth, indicating the effectiveness and reliability of the Knee Sleeve system for the prediction of different lower body joints beyond the knees. The results enable human pose estimation in a seamless manner without being limited by visual occlusion or the field of view of cameras. Our results show the potential of multimodal wearable sensing in a variety of applications from home fitness to sports, healthcare, and physical rehabilitation focusing on pose and movement estimation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 62 references that are in the map. First posted on arXiv 2 Oct 2023.
Builds on
25 of 62 references.
References · 25
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 2016RMPE: Regional Multi-person Pose Estimationcited by 340
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2020Whole-Body Human Pose Estimation in the Wildcited by 178
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 144
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
13 more
- 2017Towards Accurate Multi-person Pose Estimation in the Wildcited by 131
- 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 108
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
- 2022mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensorscited by 37
- 2019A Deep Learning Framework for Assessing Physical Rehabilitation Exercisescited by 26
- 2018Eye in the Sky: Real-time Drone Surveillance System (DSS) for Violent Individuals Identification using ScatterNet Hybrid Deep Learning Networkcited by 20
- 2022Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimationcited by 9
- 2021Dynamic Modeling of Hand-Object Interactions via Tactile Sensingcited by 8
- 2022SemiPFL: Personalized Semi-Supervised Federated Learning Framework for Edge Intelligencecited by 7
- 2022Computational Design of Kinesthetic Garmentscited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.