mlsanityData to 14 Oct 2026

EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset

arXiv 2609.17189 ↗First posted 15 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D hand mesh reconstruction is a challenging yet essential task for downstream applications, including human-robot interaction and AR/VR. Although conventional cameras have been widely adopted for this task, methods that rely on them struggle in low-light environments and under severe motion blur. To address these limitations, event-based cameras have recently attracted attention for their high dynamic range and high temporal resolution. However, applying event cameras to egocentric hand reconstruction remains challenging because camera wearer's motion produces dense background events that obscure hand-specific signals. Although the first egocentric event-based approach mitigates this issue using hand segmentation, its binary hand mask does not distinguish between left and right hands. As a result, the model lacks instance-level hand information and predicts both hands even when only one or neither hand is present. This limitation leads to incorrect inter-hand relationships and degraded reconstruction accuracy. In this paper, we propose EventEgoHands++, a framework for event-based 3D hand mesh reconstruction from an egocentric viewpoint. The proposed method incorporates a Hand Detector that estimates instance-level bounding boxes and masks for both the left and right hands. Moreover, we introduce Adaptive Attention, which dynamically gates the attention based on these detection results to accurately learn the spatial relationship and mutual interactions between the hands. To train and evaluate our framework, we extend the synthetic N-HOT3D dataset and newly construct EEH-R, the largest real-world event-based egocentric hand dataset to date, comprising approximately 1M annotated frames captured in environments including low-light conditions. Extensive experiments on both synthetic and real datasets demonstrate that our method consistently outperforms the baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 80 of its 108 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

80 of 108 references.

References · 80

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  6. 2019Event-based Vision: A Surveycited by 1,016
  7. 2025SAM 3: Segment Anything with Conceptscited by 906
  8. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  9. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
  10. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
  11. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
  12. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
38 more
  1. 2023Reconstructing Hands in 3D with Transformerscited by 306
  2. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
  3. 2020Understanding Human Hands in Contact at Internet Scalecited by 281
  4. 2021Mesh Graphormercited by 265
  5. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
  6. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 230
  7. 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
  8. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  9. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 183
  10. 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 166
  11. 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 155
  12. 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 140
  13. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
  14. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  15. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
  16. 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
  17. 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 111
  18. 2022HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Networkcited by 96
  19. 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
  20. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  21. 2023An Outlook into the Future of Egocentric Visioncited by 84
  22. 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
  23. 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 75
  24. 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
  25. 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 66
  26. 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
  27. 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Modelscited by 57
  28. 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
  29. 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 51
  30. 2020EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Streamcited by 48
  31. 2022Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videoscited by 35
  32. 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 34
  33. 20233D Hand Pose Estimation in Everyday Egocentric Imagescited by 34
  34. 2019Single Image 3D Hand Reconstruction with Mesh Convolutionscited by 32
  35. 2023Helping Hands: An Object-Aware Ego-Centric Video Recognition Modelcited by 31
  36. 2016Robust 3D Hand Pose Estimation in Single Depth Images: from Single-View CNN to Multi-View CNNscited by 29
  37. 2024EventEgo3D: 3D Human Motion Capture from Egocentric Event Streamscited by 29
  38. 2024E2GS: Event Enhanced Gaussian Splattingcited by 26

50 most cited of 80 All 80 (JSON)

Built on by

Not cited yet.