mlsanityData to 7 Oct 2026

EvHandPose: Event-based 3D Hand Pose Estimation with Sparse Supervision

arXiv 2303.02862 ↗First posted 6 Mar 2023cs.CV cs.AIcited by 17

Not on the map. Why?

Abstract (arXiv)

Event camera shows great potential in 3D hand pose estimation, especially addressing the challenges of fast motion and high dynamic range in a low-power way. However, due to the asynchronous differential imaging mechanism, it is challenging to design event representation to encode hand motion information especially when the hands are not moving (causing motion ambiguity), and it is infeasible to fully annotate the temporally dense event stream. In this paper, we propose EvHandPose with novel hand flow representations in Event-to-Pose module for accurate hand pose estimation and alleviating the motion ambiguity issue. To solve the problem under sparse annotation, we design contrast maximization and hand-edge constraints in Pose-to-IWE (Image with Warped Events) module and formulate EvHandPose in a weakly-supervision framework. We further build EvRealHands, the first large-scale real-world event-based hand pose dataset on several challenging scenes to bridge the real-synthetic domain gap. Experiments on EvRealHands demonstrate that EvHandPose outperforms previous event-based methods under all evaluation scenes, achieves accurate and stable hand pose estimation with high temporal resolution in fast motion and strong light scenes compared with RGB-based methods, generalizes well to outdoor scenes and another type of event camera, and shows the potential for the hand gesture recognition task.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 43 of its 80 references that are in the map. First posted on arXiv 6 Mar 2023.

Builds on

43 of 80 references.

References · 43

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  4. 2017Learning from Synthetic Humanscited by 358
  5. 2019High Speed and High Dynamic Range Video with an Event Cameracited by 344
  6. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
  7. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  8. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  9. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  10. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  11. 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 223
  12. 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 216
31 more
  1. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 197
  2. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  3. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
  4. 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
  5. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  6. 2019Video to Events: Recycling Video Datasets for Event Camerascited by 162
  7. 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 157
  8. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  9. 2020Leveraging Photometric Consistency over Time for Sparsely Supervised Hand-Object Reconstructioncited by 139
  10. 2020Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipelinecited by 131
  11. 2018Event-based Moving Object Detection and Trackingcited by 126
  12. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  13. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  14. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  15. 2020Event-based Stereo Visual Odometrycited by 105
  16. 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
  17. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  18. 2019Focus Is All You Need: Loss Functions For Event-based Visioncited by 83
  19. 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
  20. 2021Time-Ordered Recent Event (TORE) Volumes for Event Camerascited by 73
  21. 2019EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Cameracited by 65
  22. 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
  23. 2020EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Streamcited by 48
  24. 2017BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysiscited by 46
  25. 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
  26. 2021Bridging the Gap between Events and Frames through Unsupervised Domain Adaptationcited by 36
  27. 20163D Hand Pose Tracking and Estimation Using Stereo Matchingcited by 35
  28. 2021Differentiable Event Stream Simulator for Non-Rigid 3D Trackingcited by 23
  29. 2015Depth-based hand pose estimation: methods, data, and challengescited by 16
  30. 2019Slim DensePose: Thrifty Learning from Sparse Annotations and Motion Cuescited by 13
  31. 2020Recent Advances in 3D Object and Hand Pose Estimationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 10; 2026: 3.

17 papers.

Sort:

By area:

  1. 2024EventEgo3D: 3D Human Motion Capture from Egocentric Event Streamscited by 29
  2. 2025EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Cameracited by 6
  3. 2024EF-Calib: Spatiotemporal Calibration of Event- and Frame-Based Cameras Using Continuous-Time Trajectoriescited by 5
  4. 2025EventEgoHands: Event-based Egocentric 3D Hand Mesh Reconstructioncited by 5
  5. 2025PEOD: A Pixel-Aligned Event-RGB Benchmark for Object Detection under Challenging Conditionscited by 4
  6. 2025EgoEvGesture: Gesture Recognition Based on Egocentric Event Cameracited by 3
  7. 2025From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Camerascited by 3
  8. 2025Leveraging RGB Images for Pre-Training of Event-Based Hand Pose Estimationcited by 3
  9. 2025Edge Intelligence with Spiking Neural Networkscited by 2
  10. 2026EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Camerascited by 2
  11. 2023EvPlug: Learn a Plug-and-Play Module for Event and Image Fusioncited by 1
  12. 2024ExFMan: Rendering 3D Dynamic Humans with Hybrid Monocular Blurry Frames and Eventscited by 1
5 more
  1. 2025EvHand-FPV: Efficient Event-Based 3D Hand Tracking from First-Person Viewcited by 1
  2. 2025EHPE: A Segmented Architecture for Enhanced Hand Pose Estimationcited by 0
  3. 2025Reconstruction as a Bridge for Event-Based Visual Question Answeringcited by 0
  4. 2026MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recoverycited by 0
  5. 2026EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Datasetcited by 0