mlsanityData to 14 Oct 2026

OmniEgoCap: Camera-Agnostic Sequence-Level Egocentric Motion Reconstruction

arXiv 2512.19283 ↗First posted 22 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of commercial egocentric devices offers a unique lens into human behavior, yet reconstructing full-body 3D motion remains difficult due to frequent self-occlusion and the 'out-of-sight' nature of the wearer's limbs. While head and hand trajectories provide sparse anchor points, current methods often overfit to specific hardware optics or rely on expensive, post-hoc optimizations that compromise motion naturalness. In this paper, we present OmniEgoCap, a unified diffusion framework that scales egocentric reconstruction to diverse capture setups. By shifting from short-term windowed estimation to sequence-level inference, our method captures a global perspective and recovers invariant physical attributes, such as height and body proportions, that provide critical constraints for disambiguating head-only cues. To ensure hardware-agnostic generalization, we introduce a geometry-aware visibility augmentation strategy that treats intermittent hand appearances as principled geometric constraints rather than missing data. Our architecture jointly predicts temporally coherent motion and consistent body shape, establishing a new state-of-the-art on public benchmarks and demonstrating robust performance across diverse, in-the-wild environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 63 of its 76 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

63 of 76 references.

References · 63

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2020Longformer: The Long-Document Transformercited by 3,413
  7. 2023Mistral 7Bcited by 3,164
  8. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  9. 2022Human Motion Diffusion Modelcited by 1,080
  10. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  11. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
  12. 2020Rescaling Egocentric Visioncited by 540
38 more
  1. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  2. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
  3. 2021Robust Motion In-betweeningcited by 229
  4. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  5. 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
  6. 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 208
  7. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
  8. 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 146
  9. 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
  10. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
  11. 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 110
  12. 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 109
  13. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
  14. 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
  15. 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
  16. 2019Ego-Pose Estimation and Forecasting as Real-Time PD Controlcited by 87
  17. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  18. 2022QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatarscited by 77
  19. 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 76
  20. 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 66
  21. 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 65
  22. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
  23. 2022UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capturecited by 57
  24. 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
  25. 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 55
  26. 2020SelfPose: 3D Egocentric Pose Estimation from a Headset Mounted Cameracited by 49
  27. 2025GENMO: A GENeralist Model for Human MOtioncited by 49
  28. 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
  29. 2016Seeing Invisible Poses: Estimating 3D Body Pose from Egocentric Videocited by 45
  30. 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesiscited by 45
  31. 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 43
  32. 2023EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywherecited by 34
  33. 2023DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusioncited by 31
  34. 2023Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinementcited by 31
  35. 2024Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Cameracited by 31
  36. 2022Scene-aware Egocentric 3D Human Pose Estimationcited by 30
  37. 2023Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensorscited by 30
  38. 2021Egocentric Pose Estimation from Human Vision Spancited by 27

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.