EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcing
Not on the map. Why?
Abstract (arXiv)
With recent advances in embodied agents and AR devices, egocentric observations are readily available as input for real-world interactive online applications. However, egocentric viewpoints can only sporadically observe hands, in addition to the estimated head trajectory. We propose EgoForce, an online framework for reconstructing long-term full-body motion from noisy egocentric input. While existing generative frameworks can robustly handle noisy and sparse measurements, they assume a fixed-length observation window is available and are thus not suitable for real-time applications. Faster inference often relies on autoregressive prediction, sacrificing robustness. In contrast, we adopt a diffusion-based method with a temporally asymmetric noise schedule inspired by Diffusion Forcing. Specifically, our approach models temporally evolving uncertainty and incrementally denoises states as new streaming observations arrive. Combined with a noise-robust imputation strategy, EgoForce progressively generates stable and coherent full-body motion under strict causal constraints. Experiments demonstrate that our online framework outperforms existing online and offline methods, enabling long-horizon, full-body motion reconstruction in challenging egocentric scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 48 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
43 of 48 references.
References · 43
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
31 more
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 139
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 110
- 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 98
- 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
- 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 94
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
- 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
- 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
- 2024Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Modelscited by 56
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusioncited by 55
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
- 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
- 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 43
- 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 38
- 2023EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywherecited by 34
- 2024PDP: Physics-Based Character Animation via Diffusion Policycited by 31
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2024EgoLM: Multi-Modal Language Model of Egocentric Motionscited by 28
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
- 2025UniPhys: Unified Planner and Controller with Diffusion for Flexible Physics-Based Character Controlcited by 25
- 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generationcited by 17
- 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactionscited by 11
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generationcited by 10
- 2025Motion Synthesis with Sparse and Flexible Keyjoint Controlcited by 9
- 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modelingcited by 4
Built on by
Not cited yet.