mlsanityData to 7 Oct 2026

Understanding Egocentric Hand-Object Interactions from Hand Pose Estimation

arXiv 2109.14657 ↗First posted 29 Sep 2021cs.CV cs.HCcited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper, we address the problem of estimating the hand pose from the egocentric view when the hand is interacting with objects. Specifically, we propose a method to label a dataset Ego-Siam which contains the egocentric images pair-wisely. We also use the collected pairwise data to train our encoder-decoder style network which has been proven efficient in. This could bring extra training efficiency and testing accuracy. Our network is lightweight and can be performed with over 30 FPS with an outdated GPU. We demonstrate that our method outperforms Mueller et al. which is the state of the art work dealing with egocentric hand-object interaction problems on the GANerated dataset. To show the ability to preserve the semantic information of our method, we also report the performance of grasp type classification on GUN-71 dataset and outperforms the benchmark by only using the predicted 3-d hand pose.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 34 references that are in the map. First posted on arXiv 29 Sep 2021.

Builds on

15 of 34 references.

References · 15

  1. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  2. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  3. 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
  4. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  5. 2020Understanding Human Hands in Contact at Internet Scalecited by 281
  6. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  7. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  8. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  9. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 229
  10. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  11. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  12. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
3 more
  1. 2019H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactionscited by 139
  2. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  3. 2020Two-hand Global 3D Pose Estimation Using Monocular RGBcited by 27

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 1.

5 papers.

  1. 2023An Outlook into the Future of Egocentric Visioncited by 84
  2. 2021E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognitioncited by 50
  3. 2022Domain Adaptive Hand Keypoint and Pixel Localization in the Wildcited by 14
  4. 2022Egocentric Human-Object Interaction Detection Exploiting Synthetic Datacited by 11
  5. 2024Benchmarking 2D Egocentric Hand Pose Datasetscited by 3