EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset
Not on the map. Why?
Abstract (arXiv)
3D hand mesh reconstruction is a challenging yet essential task for downstream applications, including human-robot interaction and AR/VR. Although conventional cameras have been widely adopted for this task, methods that rely on them struggle in low-light environments and under severe motion blur. To address these limitations, event-based cameras have recently attracted attention for their high dynamic range and high temporal resolution. However, applying event cameras to egocentric hand reconstruction remains challenging because camera wearer's motion produces dense background events that obscure hand-specific signals. Although the first egocentric event-based approach mitigates this issue using hand segmentation, its binary hand mask does not distinguish between left and right hands. As a result, the model lacks instance-level hand information and predicts both hands even when only one or neither hand is present. This limitation leads to incorrect inter-hand relationships and degraded reconstruction accuracy. In this paper, we propose EventEgoHands++, a framework for event-based 3D hand mesh reconstruction from an egocentric viewpoint. The proposed method incorporates a Hand Detector that estimates instance-level bounding boxes and masks for both the left and right hands. Moreover, we introduce Adaptive Attention, which dynamically gates the attention based on these detection results to accurately learn the spatial relationship and mutual interactions between the hands. To train and evaluate our framework, we extend the synthetic N-HOT3D dataset and newly construct EEH-R, the largest real-world event-based egocentric hand dataset to date, comprising approximately 1M annotated frames captured in environments including low-light conditions. Extensive experiments on both synthetic and real datasets demonstrate that our method consistently outperforms the baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 80 of its 108 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
80 of 108 references.
References · 80
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2019Event-based Vision: A Surveycited by 1,016
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
38 more
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
- 2020Understanding Human Hands in Contact at Internet Scalecited by 281
- 2021Mesh Graphormercited by 265
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
- 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 230
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
- 20193D Hand Shape and Pose from Images in the Wildcited by 190
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 183
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 166
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 155
- 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 140
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
- 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
- 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 111
- 2022HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Networkcited by 96
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
- 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
- 2023An Outlook into the Future of Egocentric Visioncited by 84
- 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
- 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 75
- 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 66
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
- 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Modelscited by 57
- 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
- 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 51
- 2020EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Streamcited by 48
- 2022Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videoscited by 35
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 34
- 20233D Hand Pose Estimation in Everyday Egocentric Imagescited by 34
- 2019Single Image 3D Hand Reconstruction with Mesh Convolutionscited by 32
- 2023Helping Hands: An Object-Aware Ego-Centric Video Recognition Modelcited by 31
- 2016Robust 3D Hand Pose Estimation in Single Depth Images: from Single-View CNN to Multi-View CNNscited by 29
- 2024EventEgo3D: 3D Human Motion Capture from Egocentric Event Streamscited by 29
- 2024E2GS: Event Enhanced Gaussian Splattingcited by 26
50 most cited of 80 All 80 (JSON)
Built on by
Not cited yet.