mlsanityData to 7 Oct 2026

InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video

arXiv 2609.35743 ↗First posted 28 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

World-space hand motion estimation from egocentric video requires recovering 3D articulated hand geometry while tracking camera egomotion. Existing approaches heavily rely on cascading independent hand pose estimators and SLAM systems, resulting in error accumulation, complex pipelines, and severe computational overhead. To address these limitations, we present InfiniHand, an end-to-end streaming feed-forward framework that jointly estimates MANO parameters, camera trajectories, and hand locations directly from uncalibrated egocentric video. InfiniHand integrates persistent spatiotemporal memory with hand-centered visual features, explicitly coupling camera motion with local hand geometry within a unified architecture. We train InfiniHand in two progressive stages by first learning robust camera-space hand priors and then extending to streaming world-space reconstruction. To support this process, we aggregate a pretraining corpus of approximately 5,000 hours of egocentric data across multiple public datasets. Extensive evaluations demonstrate that InfiniHand outperforms state-of-the-art baselines on in-domain benchmarks, achieving a 21.4% reduction in ARCTIC PA-p compared to ViDiHand while substantially mitigating world-space drift. Furthermore, InfiniHand generalizes robustly to in-the-wild videos and operates at 11.19 FPS, delivering more than twice the throughput of HaWoR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 34 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

30 of 34 references.

References · 30

  1. 2021Vision Transformers for Dense Predictioncited by 1,789
  2. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  3. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  4. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
  5. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  6. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  7. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  8. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  9. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  10. 2023Reconstructing Hands in 3D with Transformerscited by 298
  11. 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
  12. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
18 more
  1. 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
  2. 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
  3. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
  4. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
  5. 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 62
  6. 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 50
  7. 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 49
  8. 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
  9. 2023Bringing Inputs to Shared Domains for 3D Interacting Hands Recovery in the Wildcited by 36
  10. 2024R+X: Retrieval and Execution from Everyday Human Videoscited by 36
  11. 20233D Hand Pose Estimation in Everyday Egocentric Imagescited by 33
  12. 2026LoGeR: Long-Context Geometric Reconstruction with Hybrid Memorycited by 33
  13. 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 32
  14. 2026EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Datacited by 17
  15. 2026EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Taskscited by 15
  16. 2024OmniHands: Towards Robust 4D Hand Mesh Recovery via A Versatile Transformercited by 6
  17. 2026The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstructioncited by 4
  18. 2026M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAMcited by 1

Built on by

Not cited yet.