mlsanityData to 7 Oct 2026

UltraGlove: Hand Pose Estimation with Mems-Ultrasonic Sensors

arXiv 2306.12652 ↗First posted 22 Jun 2023cs.CV cs.GR cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Hand tracking is an important aspect of human-computer interaction and has a wide range of applications in extended reality devices. However, current hand motion capture methods suffer from various limitations. For instance, visual-based hand pose estimation is susceptible to self-occlusion and changes in lighting conditions, while IMU-based tracking gloves experience significant drift and are not resistant to external magnetic field interference. To address these issues, we propose a novel and low-cost hand-tracking glove that utilizes several MEMS-ultrasonic sensors attached to the fingers, to measure the distance matrix among the sensors. Our lightweight deep network then reconstructs the hand pose from the distance matrix. Our experimental results demonstrate that this approach is both accurate, size-agnostic, and robust to external interference. We also show the design logic for the sensor selection, sensor configurations, circuit diagram, as well as model architecture.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 67 references that are in the map. First posted on arXiv 22 Jun 2023.

Builds on

24 of 67 references.

References · 24

  1. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  2. 2021Mesh Graphormercited by 264
  3. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  4. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  5. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  6. 2019Learnable Triangulation of Human Posecited by 160
  7. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  8. 2020Epipolar Transformerscited by 117
  9. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  10. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  11. 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 108
  12. 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
12 more
  1. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  2. 2022Interacting Attention Graph for Single Image Two-Hand Reconstructioncited by 87
  3. 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 75
  4. 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Cameracited by 70
  5. 2019EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Cameracited by 65
  6. 2020Lightweight Multi-View 3D Pose Estimation through Camera-Disentangled Representationcited by 57
  7. 2019A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation from a Single Depth Imagecited by 56
  8. 2022UmeTrack: Unified multi-view end-to-end hand tracking for VRcited by 48
  9. 2018Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Timecited by 47
  10. 2021Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentationcited by 40
  11. 2021Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinementscited by 27
  12. 2021RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Videocited by 23

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model Agentscited by 4