mlsanityData to 14 Oct 2026

EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Camera

arXiv 2502.07869 ↗First posted 11 Feb 2025cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Monocular egocentric 3D human motion capture remains a significant challenge, particularly under conditions of low lighting and fast movements, which are common in head-mounted device applications. Existing methods that rely on RGB cameras often fail under these conditions. To address these limitations, we introduce EventEgo3D++, the first approach that leverages a monocular event camera with a fisheye lens for 3D human motion capture. Event cameras excel in high-speed scenarios and varying illumination due to their high temporal resolution, providing reliable cues for accurate 3D human motion capture. EventEgo3D++ leverages the LNES representation of event streams to enable precise 3D reconstructions. We have also developed a mobile head-mounted device (HMD) prototype equipped with an event camera, capturing a comprehensive dataset that includes real event observations from both controlled studio environments and in-the-wild settings, in addition to a synthetic dataset. Additionally, to provide a more holistic dataset, we include allocentric RGB streams that offer different perspectives of the HMD wearer, along with their corresponding SMPL body model. Our experiments demonstrate that EventEgo3D++ achieves superior 3D accuracy and robustness compared to existing solutions, even in challenging conditions. Moreover, our method supports real-time 3D pose updates at a rate of 140Hz. This work is an extension of the EventEgo3D approach (CVPR 2024) and further advances the state of the art in egocentric 3D human motion capture. For more details, visit the project page at https://eventego3d.mpi-inf.mpg.de.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 44 of its 86 references that are in the map. First posted on arXiv 11 Feb 2025.

Builds on

44 of 86 references.

References · 44

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2017Learning from Synthetic Humanscited by 359
  4. 2019High Speed and High Dynamic Range Video with an Event Cameracited by 345
  5. 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
  6. 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
  7. 2019Events-to-Video: Bringing Modern Computer Vision to Event Camerascited by 193
  8. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
  9. 2019Video to Events: Recycling Video Datasets for Event Camerascited by 165
  10. 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 146
  11. 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
  12. 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 109
32 more
  1. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
  2. 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
  3. 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
  4. 2022QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatarscited by 77
  5. 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 76
  6. 2019EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Cameracited by 65
  7. 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 60
  8. 2022UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capturecited by 57
  9. 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
  10. 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 55
  11. 2020EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Streamcited by 48
  12. 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
  13. 2018Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Timecited by 47
  14. 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 43
  15. 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
  16. 2022Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervisioncited by 34
  17. 2023Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinementcited by 31
  18. 2022Scene-aware Egocentric 3D Human Pose Estimationcited by 30
  19. 2024EventEgo3D: 3D Human Motion Capture from Egocentric Event Streamscited by 29
  20. 2023QuestEnvSim: Environment-Aware Simulated Motion Tracking from Sparse Sensorscited by 28
  21. 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
  22. 2021TransPose: Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensorscited by 25
  23. 2016EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras (Extended Abstract)cited by 24
  24. 2021Differentiable Event Stream Simulator for Non-Rigid 3D Trackingcited by 23
  25. 20233D Human Pose Perception from Egocentric Stereo Videoscited by 23
  26. 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Viewscited by 22
  27. 2022Event-based Non-Rigid Reconstruction from Contourscited by 17
  28. 2023EvHandPose: Event-based 3D Hand Pose Estimation with Sparse Supervisioncited by 17
  29. 20233D Pose Estimation of Two Interacting Hands from a Monocular Event Cameracited by 17
  30. 2024Complementing Event Streams and RGB Frames for Hand Mesh Reconstructioncited by 14
  31. 2024Attention-Propagation Network for Egocentric Heatmap to 3D Pose Liftingcited by 13
  32. 2023EvAC3D: From Event-based Apparent Contours to 3D Models via Continuous Visual Hullscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

  1. 2025Bring Your Rear Cameras for Egocentric 3D Human Pose Estimationcited by 7
  2. 2025From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Camerascited by 3
  3. 2026EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Cameracited by 3
  4. 2026E-3DPSM: A State Machine for Event-Based Egocentric 3D Human Pose Estimationcited by 1
  5. 2026EventNeuS: 3D Mesh Reconstruction from a Single Event Cameracited by 0
  6. 2026EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Datasetcited by 0