mlsanityData to 14 Oct 2026

UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capture

arXiv 2208.01633 ↗First posted 2 Aug 2022cs.CVcited by 57

Not on the map. Why?

Abstract (arXiv)

We present UnrealEgo, i.e., a new large-scale naturalistic dataset for egocentric 3D human pose estimation. UnrealEgo is based on an advanced concept of eyeglasses equipped with two fisheye cameras that can be used in unconstrained environments. We design their virtual prototype and attach them to 3D human models for stereo view capture. We next generate a large corpus of human motions. As a consequence, UnrealEgo is the first dataset to provide in-the-wild stereo images with the largest variety of motions among existing egocentric datasets. Furthermore, we propose a new benchmark method with a simple but effective idea of devising a 2D keypoint estimation module for stereo inputs to improve 3D human pose estimation. The extensive experiments show that our approach outperforms the previous state-of-the-art methods qualitatively and quantitatively. UnrealEgo and our source codes are available on our project web page.

Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 2 Aug 2022.

Builds on

21 of 46 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  6. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
  7. 2017Learning from Synthetic Humanscited by 359
  8. 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 205
  9. 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
  10. 2019xR-EgoPose: Egocentric 3D Human Pose from an HMD Cameracited by 79
  11. 2018Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Cameracited by 68
  12. 20193DPeople: Modeling the Geometry of Dressed Humanscited by 58
9 more
  1. 2020MoVi: A Large Multipurpose Motion and Video Datasetcited by 58
  2. 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
  3. 2020SelfPose: 3D Egocentric Pose Estimation from a Headset Mounted Cameracited by 49
  4. 2021HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Mediacited by 29
  5. 2021Egocentric Pose Estimation from Human Vision Spancited by 27
  6. 2019Learning Multi-Human Optical Flowcited by 26
  7. 2020SimPose: Effectively Learning DensePose and Surface Normals of People from Simulated Datacited by 17
  8. 2019Learning to Train with Synthetic Humanscited by 14
  9. 2021Egocentric Videoconferencingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 8; 2024: 17; 2025: 18; 2026: 11.

57 papers.

Sort:

By area:

  1. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
  2. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
  3. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
  4. 2023An Outlook into the Future of Egocentric Visioncited by 84
  5. 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
  6. 2024EgoExo-Fitness: Towards Egocentric and Exocentric Full-Body Action Understandingcited by 36
  7. 2023EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywherecited by 34
  8. 2023Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinementcited by 31
  9. 2022Scene-aware Egocentric 3D Human Pose Estimationcited by 30
  10. 2024EventEgo3D: 3D Human Motion Capture from Egocentric Event Streamscited by 29
  11. 2024EgoGen: An Egocentric Synthetic Data Generatorcited by 27
  12. 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
38 more
  1. 2022EgoLoc: Revisiting 3D Object Localization from Egocentric Videos with Visual Queriescited by 25
  2. 2024HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observationscited by 25
  3. 20233D Human Pose Perception from Egocentric Stereo Videoscited by 23
  4. 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Viewscited by 22
  5. 2025Challenges and Trends in Egocentric Vision: A Surveycited by 20
  6. 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenescited by 18
  7. 2024Real-Time Simulated Avatar from Head-Mounted Sensorscited by 17
  8. 2025Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Inputcited by 17
  9. 2025The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimationcited by 16
  10. 2025EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activitycited by 15
  11. 2025REWIND: Real-Time Egocentric Whole-Body Motion Diffusion with Exemplar-Based Identity Conditioningcited by 14
  12. 2024Attention-Propagation Network for Egocentric Heatmap to 3D Pose Liftingcited by 13
  13. 2024EMHI: A Multimodal Egocentric Human Motion Dataset with HMD and Body-Worn IMUscited by 13
  14. 2024SimpleEgo: Predicting Probabilistic Body Pose from Egocentric Camerascited by 12
  15. 2024DivaTrack: Diverse Bodies and Motions from Acceleration-Enhanced Three-Point Trackerscited by 11
  16. 2025E-3DGS: Event-Based Novel View Rendering of Large-Scale Scenes Using 3D Gaussian Splattingcited by 9
  17. 2024A Survey on 3D Egocentric Human Pose Estimationcited by 8
  18. 2024EgoAvatar: Egocentric View-Driven and Photorealistic Full-body Avatarscited by 8
  19. 2025Bring Your Rear Cameras for Egocentric 3D Human Pose Estimationcited by 7
  20. 2025EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Cameracited by 6
  21. 2024HiSC4D: Human-centered interaction and 4D Scene Capture in Large-scale Space Using Wearable IMUs and LiDARcited by 5
  22. 2025FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Videocited by 5
  23. 2025ECHO: Ego-Centric modeling of Human-Object interactionscited by 5
  24. 2024EgoPoseFormer: A Simple Baseline for Stereo Egocentric 3D Human Pose Estimationcited by 4
  25. 2024XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registrationcited by 3
  26. 2025Fish2Mesh Transformer: 3D Human Mesh Recovery from Egocentric Visioncited by 3
  27. 2026NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Datacited by 3
  28. 2025EgoMusic-driven Human Dance Motion Estimation with Skeleton Mambacited by 2
  29. 2026EgoPoseFormer v2: Accurate Egocentric Human Motion Estimation for AR/VRcited by 2
  30. 2025Event-based Egocentric Human Pose Estimation in Dynamic Environmentcited by 1
  31. 2025Systematic Comparison of Projection Methods for Monocular 3D Human Pose Estimation on Fisheye Imagescited by 1
  32. 2025Prime and Reach: Synthesising Body Motion for Gaze-Primed Object Reachcited by 1
  33. 2026Egocentric Visibility-Aware Human Pose Estimationcited by 1
  34. 2026E-3DPSM: A State Machine for Event-Based Egocentric 3D Human Pose Estimationcited by 1
  35. 2026Towards Real-World Wearable Motion Reconstructioncited by 1
  36. 2024Social EgoMesh Estimationcited by 0
  37. 2025EgoAnimate: Generating Human Animations from Egocentric top-down Viewscited by 0
  38. 2025OmniEgoCap: Camera-Agnostic Sequence-Level Egocentric Motion Reconstructioncited by 0

50 most cited of 57 All 57 (JSON)