Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video
Not on the map. Why?
Abstract (arXiv)
Monocular egocentric human pose estimation is essential for ubiquitous activity monitoring. However, understanding the user's absolute location within the environment remains a challenge. Existing methods primarily focus on relative motion from an initial position, and tend not to account for the wearer's absolute location within an environment. Furthermore, inherent scale ambiguity in monocular vision leads to severe translational drift, limiting long-term tracking without specialized multi-sensor hardware. To address this, we propose MapMonoEgo, a novel framework achieving globally consistent human pose estimation solely from a monocular camera by leveraging a pre-scanned 3D point cloud. We also introduce AIST-Living dataset, a new dataset pairing egocentric video with ground-truth motion in a scanned environment. Experiments demonstrate that our approach significantly outperforms the state-of-the-art baseline, proving its utility for practical monitoring tasks without specialized hardware.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
23 of 31 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 208
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 121
11 more
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
- 2019Ego-Pose Estimation and Forecasting as Real-Time PD Controlcited by 87
- 2019You2Me: Inferring Body Pose in Egocentric Video via First and Second Person Interactionscited by 82
- 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
- 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 68
- 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
- 2021SOMA: Solving Optical Marker-Based MoCap Automaticallycited by 31
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
- 2025Challenges and Trends in Egocentric Vision: A Surveycited by 20
- 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generationcited by 17
Built on by
Not cited yet.