OmniEgoCap: Camera-Agnostic Sequence-Level Egocentric Motion Reconstruction
Not on the map. Why?
Abstract (arXiv)
The proliferation of commercial egocentric devices offers a unique lens into human behavior, yet reconstructing full-body 3D motion remains difficult due to frequent self-occlusion and the 'out-of-sight' nature of the wearer's limbs. While head and hand trajectories provide sparse anchor points, current methods often overfit to specific hardware optics or rely on expensive, post-hoc optimizations that compromise motion naturalness. In this paper, we present OmniEgoCap, a unified diffusion framework that scales egocentric reconstruction to diverse capture setups. By shifting from short-term windowed estimation to sequence-level inference, our method captures a global perspective and recovers invariant physical attributes, such as height and body proportions, that provide critical constraints for disambiguating head-only cues. To ensure hardware-agnostic generalization, we introduce a geometry-aware visibility augmentation strategy that treats intermittent hand appearances as principled geometric constraints rather than missing data. Our architecture jointly predicts temporally coherent motion and consistent body shape, establishing a new state-of-the-art on public benchmarks and demonstrating robust performance across diverse, in-the-wild environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 63 of its 76 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
63 of 76 references.
References · 63
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023Mistral 7Bcited by 3,164
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2020Rescaling Egocentric Visioncited by 540
38 more
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2021Robust Motion In-betweeningcited by 229
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 208
- 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
- 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 146
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 110
- 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 109
- 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
- 2019Ego-Pose Estimation and Forecasting as Real-Time PD Controlcited by 87
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
- 2022QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatarscited by 77
- 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 76
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 66
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 65
- 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
- 2022UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capturecited by 57
- 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
- 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 55
- 2020SelfPose: 3D Egocentric Pose Estimation from a Headset Mounted Cameracited by 49
- 2025GENMO: A GENeralist Model for Human MOtioncited by 49
- 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
- 2016Seeing Invisible Poses: Estimating 3D Body Pose from Egocentric Videocited by 45
- 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesiscited by 45
- 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 43
- 2023EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywherecited by 34
- 2023DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusioncited by 31
- 2023Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinementcited by 31
- 2024Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Cameracited by 31
- 2022Scene-aware Egocentric 3D Human Pose Estimationcited by 30
- 2023Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensorscited by 30
- 2021Egocentric Pose Estimation from Human Vision Spancited by 27
50 most cited of 63 All 63 (JSON)
Built on by
Not cited yet.