Garment Inertial Denoiser (GID): Endowing Accurate Motion Capture via Loose IMU Denoiser
Not on the map. Why?
Abstract (arXiv)
Wearable inertial motion capture (MoCap) provides a portable, occlusion-free, and privacy-preserving alternative to camera-based systems, but its accuracy depends on tightly attached sensors - an intrusive and uncomfortable requirement for daily use. Embedding IMUs into loose-fitting garments is a desirable alternative, yet sensor-body displacement introduces severe, structured, and location-dependent corruption that breaks standard inertial pipelines. We propose GID (Garment Inertial Denoiser), a lightweight, plug-and-play Transformer that factorizes loose-wear MoCap into three stages: (i) location-specific denoising, (ii) adaptive cross-wear fusion, and (iii) general pose prediction. GID uses a location-aware expert architecture, where a shared spatio-temporal backbone models global motion while per-IMU expert heads specialize in local garment dynamics, and a lightweight fusion module ensures cross-part consistency. This inductive bias enables stable training and effective learning from limited paired loose-tight IMU data. We also introduce GarMoCap, a combined public and newly collected dataset covering diverse users, motions, and garments. Experiments show that GID enables accurate, real-time denoising from single-user training and generalizes across unseen users, motions, and garment types, consistently improving state-of-the-art inertial MoCap methods when used as a drop-in module.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
27 of 54 references.
References · 27
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 144
- 2020TransPose: Keypoint Localization via Transformercited by 126
- 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 108
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
- 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 104
- 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 75
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
15 more
- 2020SMAP: Single-Shot Multi-Person Absolute 3D Pose Estimationcited by 52
- 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
- 2021SOMA: Solving Optical Marker-Based MoCap Automaticallycited by 30
- 2024Physical Non-inertial Poser (PNP): Modeling Non-inertial Effects in Sparse-inertial Human Motion Capturecited by 24
- 2023TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecastingcited by 22
- 2023SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Datacited by 20
- 2023Multiple View Geometry Transformers for 3D Human Pose Estimationcited by 19
- 2024Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Rangingcited by 18
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimationcited by 11
- 2024DivaTrack: Diverse Bodies and Motions from Acceleration-Enhanced Three-Point Trackerscited by 11
- 2025Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capturecited by 7
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Modelscited by 5
- 2025SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Datacited by 4
- 2024SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Trackingcited by 3
- 2025FIP: Endowing Robust Motion Capture on Daily Garment by Fusing Flex and Inertial Sensorscited by 2
Built on by
Not cited yet.