mlsanityData to 13 Oct 2026

Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Pose

arXiv 2609.35764 ↗First posted 28 Sep 2026cs.CV cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Sparse inertial pose estimation promises camera-free motion capture from consumer devices, but consumer sensors are unreliable: firmware-fused orientations are biased, mounting varies between sessions, and streams drift or drop out. On a new 35-take single-subject benchmark pairing an earbud head inertial measurement unit (IMU) with two smart-insole foot IMUs (SAM-3D-Body pseudo-ground-truth labels), we show the reliability problem is channel-level: a channel ablation isolates foot acceleration as the most informative input (66.6 mm vs. 79.0 mm head-only) and the firmware-fused foot orientation as the liability that destroys the gain. We therefore let the model learn how much to trust each channel of each stream: one temporal gate per stream per channel block, trained with an auxiliary reliability objective on synthetically corrupted pretraining data. The channel-gated model is the most accurate of our learned fusion arms on clean data (69.4 mm vs. 83.7 static, 86.6 ungated) and under every simulated fault (bias in training; drift, dropout eval-only); its gates suppress the natively biased foot-orientation channels on clean real data without test-time supervision and flag dropout bursts at 0.92-0.999 AUROC. Two contrasts: dropping a channel known a priori to fail is flat across foot faults but collapses when an unanticipated stream fails (head dropout: 92.9 vs. 79.3 mm); and a fine-tuned HMD-Poser is more accurate on clean data (64.4 mm) and nominally under drift, with no significant paired difference under bias or dropout, but a larger worst-case degradation from clean (+16.1 vs. +3.5 mm, single seed). Learning to gate reliability instead of sensor count is the lever for deployable sparse inertial capture. Code is available at https://github.com/ZhilinGuo/reliability-gated-imu-fusion.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

31 of 40 references.

References · 31

  1. 2017Squeeze-and-Excitation Networkscited by 4,772
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,463
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,306
  4. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,213
  5. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,195
  6. 2015Highway Networkscited by 259
  7. 2017Gated Multimodal Units for Information Fusioncited by 246
  8. 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
  9. 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 144
  10. 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 109
  11. 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
  12. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 104
19 more
  1. 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 75
  2. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 65
  3. 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 52
  4. 2023EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywherecited by 31
  5. 2023DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusioncited by 29
  6. 2023Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensorscited by 29
  7. 2024HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observationscited by 22
  8. 2025MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devicescited by 20
  9. 2019DeepFuse: An IMU-Aware Network for Real-Time 3D Human Pose Estimation from Multi-View Imagecited by 14
  10. 2024DivaTrack: Diverse Bodies and Motions from Acceleration-Enhanced Three-Point Trackerscited by 11
  11. 2025Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capturecited by 7
  12. 2025UMotion: Uncertainty-driven Human Motion Estimation from Inertial and Ultra-wideband Unitscited by 5
  13. 2025Progressive Inertial Poser: Progressive Real-Time Kinematic Chain Estimation for 3D Full-Body Pose from Three IMU Sensorscited by 4
  14. 2026Fast SAM 3D Body: Accelerating SAM 3D Body for Real-Time Full-Body Human Mesh Recoverycited by 4
  15. 2025IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognitioncited by 3
  16. 2021Estimating Lower Body Kinematics using a Lie Group Constrained Extended Kalman Filter and Reduced IMU Countcited by 2
  17. 2025MagShield: Towards Better Robustness in Sparse Inertial Motion Capture Under Magnetic Disturbancescited by 2
  18. 2026Ground Reaction Inertial Poser: Physics-based Human Motion Capture from Sparse IMUs and Insole Pressure Sensorscited by 2
  19. 2026Towards Real-World Wearable Motion Reconstructioncited by 1

Built on by

Not cited yet.