Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors
Not on the map. Why?
Abstract (arXiv)
This paper introduces a novel human pose estimation approach using sparse inertial sensors, addressing the shortcomings of previous methods reliant on synthetic data. It leverages a diverse array of real inertial motion capture data from different skeleton formats to improve motion diversity and model generalization. This method features two innovative components: a pseudo-velocity regression model for dynamic motion capture with inertial sensors, and a part-based model dividing the body and sensor data into three regions, each focusing on their unique characteristics. The approach demonstrates superior performance over state-of-the-art models across five public datasets, notably reducing pose error by 19% on the DIP-IMU dataset, thus representing a significant improvement in inertial sensor-based human pose estimation. Our codes are available at urlhttps://github.com/dx118/dynaip.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 30 of its 50 references that are in the map. First posted on arXiv 2 Dec 2023.
Builds on
30 of 50 references.
References · 30
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 299
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 144
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 118
- 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
- 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 108
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2020SRNet: Improving Generalization in 3D Human Pose Estimation with a Split-and-Recombine Approachcited by 94
18 more
- 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 75
- 2019RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methodscited by 72
- 2019Transfer Adaptation Learning: A Decade Surveycited by 52
- 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 52
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
- 2023SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environmentscited by 47
- 2021LoBSTr: Real-time Lower-body Pose Prediction from Sparse Upper-body Tracking Signalscited by 45
- 20233D Human Mesh Estimation from Virtual Markerscited by 44
- 2022LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensorscited by 43
- 2022HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDARcited by 38
- 2022mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensorscited by 37
- 2022mmBody Benchmark: 3D Body Reconstruction Dataset and Analysis for Millimeter Wave Radarcited by 32
- 2020Fusing Wearable IMUs with Multi-View Images for Human Pose Estimation: A Geometric Approachcited by 27
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
- 2023Source-free Domain Adaptive Human Pose Estimationcited by 15
- 2023Learning Human Mesh Recovery in 3D Scenescited by 13
- 2020MARS: Mixed Virtual and Real Wearable Sensors for Human Activity Recognition with Multi-Domain Deep Learning Modelcited by 9
- 2023HuMoT: Human Motion Representation using Topology-Agnostic Transformers for Character Animation Retargetingcited by 3
Built on by
Citing papers per year: 2024: 4; 2025: 14; 2026: 11.
29 papers.
Sort:
By area:
- 2024EgoCast: Forecasting Egocentric Human Pose in the Wildcited by 11
- 2024EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modelingcited by 11
- 2025RadarLLM: Empowering Large Language Models to Understand Human Motion from Millimeter-Wave Point Cloud Sequencecited by 7
- 2025Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capturecited by 7
- 2025mmDEAR: mmWave Point Cloud Density Enhancement for Accurate Human Body Reconstructioncited by 5
- 2025FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Videocited by 5
- 2025UMotion: Uncertainty-driven Human Motion Estimation from Inertial and Ultra-wideband Unitscited by 5
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Modelscited by 5
- 2025Progressive Inertial Poser: Progressive Real-Time Kinematic Chain Estimation for 3D Full-Body Pose from Three IMU Sensorscited by 4
- 2024SMART: Scene-motion-aware human action recognition framework for mental disorder groupcited by 3
- 2024Suite-IN: Aggregating Motion Features from Apple Suite for Robust Inertial Navigationcited by 3
- 2025IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognitioncited by 3
17 more
- 2025BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devicescited by 3
- 2025MagShield: Towards Better Robustness in Sparse Inertial Motion Capture Under Magnetic Disturbancescited by 2
- 2026Ground Reaction Inertial Poser: Physics-based Human Motion Capture from Sparse IMUs and Insole Pressure Sensorscited by 2
- 2026MuPPet: Multi-person 2D-to-3D Pose Liftingcited by 2
- 2025SSPINNpose: A Self-Supervised PINN for Inertial Pose and Dynamics Estimationcited by 1
- 2026Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Cameracited by 1
- 2026Towards Real-World Wearable Motion Reconstructioncited by 1
- 2026Physical Self-Supervised Learning: IMU Sensing without Manual Labelscited by 1
- 2025Suite-IN++: A FlexiWear BodyNet Integrating Global and Local Motion Features from Apple Suite for Robust Inertial Navigationcited by 0
- 2025ChairPose: Pressure-based Chair Morphology Grounded Sitting Pose Estimation through Simulation-Assisted Trainingcited by 0
- 2025OmniEgoCap: Camera-Agnostic Sequence-Level Egocentric Motion Reconstructioncited by 0
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Predictioncited by 0
- 2026Ultra Diffusion Poser: Diffusion-Based Human Motion Tracking From Sparse Inertial Sensors and Ranging-Based Between-Sensor Distancescited by 0
- 2026IMU-HOI: A Symbiotic Framework for Coherent Human-Object Interaction and Motion Capture via Contact-Conscious Inertial Fusioncited by 0
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capturecited by 0
- 2026One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMUcited by 0
- 2026Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Posecited by 0
- 2026Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Pose28 Sep 2026
- 2026One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMU28 Sep 2026
- 2026Physical Self-Supervised Learning: IMU Sensing without Manual Labels20 Jul 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Towards Real-World Wearable Motion Reconstruction8 Jul 2026
- 2026IMU-HOI: A Symbiotic Framework for Coherent Human-Object Interaction and Motion Capture via Contact-Conscious Inertial Fusion26 Jun 2026
- 2026Ultra Diffusion Poser: Diffusion-Based Human Motion Tracking From Sparse Inertial Sensors and Ranging-Based Between-Sensor Distances1 Jun 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026MuPPet: Multi-person 2D-to-3D Pose Lifting8 Apr 2026
- 2026Ground Reaction Inertial Poser: Physics-based Human Motion Capture from Sparse IMUs and Insole Pressure Sensors17 Mar 2026
- 2026Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Camera2 Mar 2026
- 2025OmniEgoCap: Camera-Agnostic Sequence-Level Egocentric Motion Reconstruction22 Dec 2025
17 more
- 2025BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devices5 Aug 2025
- 2025IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognition3 Aug 2025
- 2025ChairPose: Pressure-based Chair Morphology Grounded Sitting Pose Estimation through Simulation-Assisted Training3 Aug 2025
- 2025MagShield: Towards Better Robustness in Sparse Inertial Motion Capture Under Magnetic Disturbances28 Jun 2025
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models18 Jun 2025
- 2025SSPINNpose: A Self-Supervised PINN for Inertial Pose and Dynamics Estimation13 Jun 2025
- 2025Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capture12 Jun 2025
- 2025UMotion: Uncertainty-driven Human Motion Estimation from Inertial and Ultra-wideband Units14 May 2025
- 2025Progressive Inertial Poser: Progressive Real-Time Kinematic Chain Estimation for 3D Full-Body Pose from Three IMU Sensors8 May 2025
- 2025RadarLLM: Empowering Large Language Models to Understand Human Motion from Millimeter-Wave Point Cloud Sequence14 Apr 2025
- 2025Suite-IN++: A FlexiWear BodyNet Integrating Global and Local Motion Features from Apple Suite for Robust Inertial Navigation1 Apr 2025
- 2025FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Video29 Mar 2025
- 2025mmDEAR: mmWave Point Cloud Density Enhancement for Accurate Human Body Reconstruction4 Mar 2025
- 2024EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modeling13 Dec 2024
- 2024EgoCast: Forecasting Egocentric Human Pose in the Wild3 Dec 2024
- 2024Suite-IN: Aggregating Motion Features from Apple Suite for Robust Inertial Navigation12 Nov 2024
- 2024SMART: Scene-motion-aware human action recognition framework for mental disorder group7 Jun 2024
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Modelscited by 5
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Predictioncited by 0
- 2026Ultra Diffusion Poser: Diffusion-Based Human Motion Tracking From Sparse Inertial Sensors and Ranging-Based Between-Sensor Distancescited by 0
- 2026Ultra Diffusion Poser: Diffusion-Based Human Motion Tracking From Sparse Inertial Sensors and Ranging-Based Between-Sensor Distances1 Jun 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models18 Jun 2025
- 2024EgoCast: Forecasting Egocentric Human Pose in the Wildcited by 11
- 2024EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modelingcited by 11
- 2025RadarLLM: Empowering Large Language Models to Understand Human Motion from Millimeter-Wave Point Cloud Sequencecited by 7
- 2025Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capturecited by 7
- 2025mmDEAR: mmWave Point Cloud Density Enhancement for Accurate Human Body Reconstructioncited by 5
- 2025FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Videocited by 5
- 2025UMotion: Uncertainty-driven Human Motion Estimation from Inertial and Ultra-wideband Unitscited by 5
- 2025Progressive Inertial Poser: Progressive Real-Time Kinematic Chain Estimation for 3D Full-Body Pose from Three IMU Sensorscited by 4
- 2024SMART: Scene-motion-aware human action recognition framework for mental disorder groupcited by 3
- 2024Suite-IN: Aggregating Motion Features from Apple Suite for Robust Inertial Navigationcited by 3
- 2025IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognitioncited by 3
- 2025BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devicescited by 3
12 most cited of 26 All 26 (JSON)
- 2026Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Pose28 Sep 2026
- 2026One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMU28 Sep 2026
- 2026Physical Self-Supervised Learning: IMU Sensing without Manual Labels20 Jul 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Towards Real-World Wearable Motion Reconstruction8 Jul 2026
- 2026IMU-HOI: A Symbiotic Framework for Coherent Human-Object Interaction and Motion Capture via Contact-Conscious Inertial Fusion26 Jun 2026
- 2026MuPPet: Multi-person 2D-to-3D Pose Lifting8 Apr 2026
- 2026Ground Reaction Inertial Poser: Physics-based Human Motion Capture from Sparse IMUs and Insole Pressure Sensors17 Mar 2026
- 2026Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Camera2 Mar 2026
- 2025OmniEgoCap: Camera-Agnostic Sequence-Level Egocentric Motion Reconstruction22 Dec 2025
- 2025BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devices5 Aug 2025
- 2025IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognition3 Aug 2025
12 newest of 26 All 26 (JSON)