mlsanityData to 14 Oct 2026

EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcing

arXiv 2605.13041 ↗First posted 13 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

With recent advances in embodied agents and AR devices, egocentric observations are readily available as input for real-world interactive online applications. However, egocentric viewpoints can only sporadically observe hands, in addition to the estimated head trajectory. We propose EgoForce, an online framework for reconstructing long-term full-body motion from noisy egocentric input. While existing generative frameworks can robustly handle noisy and sparse measurements, they assume a fixed-length observation window is available and are thus not suitable for real-time applications. Faster inference often relies on autoregressive prediction, sacrificing robustness. In contrast, we adopt a diffusion-based method with a temporally asymmetric noise schedule inspired by Diffusion Forcing. Specifically, our approach models temporally evolving uncertainty and incrementally denoises states as new streaming observations arrive. Combined with a noise-robust imputation strategy, EgoForce progressively generates stable and coherent full-body motion under strict causal constraints. Experiments demonstrate that our online framework outperforms existing online and offline methods, enabling long-horizon, full-body motion reconstruction in challenging egocentric scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 48 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

43 of 48 references.

References · 43

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  6. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  7. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  8. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
  9. 2023Reconstructing Hands in 3D with Transformerscited by 306
  10. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
  11. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  12. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
31 more
  1. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 139
  2. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
  3. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
  4. 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 110
  5. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 98
  6. 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
  7. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 94
  8. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  9. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
  10. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
  11. 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
  12. 2024Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Modelscited by 56
  13. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
  14. 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusioncited by 55
  15. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
  16. 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
  17. 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
  18. 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 43
  19. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 38
  20. 2023EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywherecited by 34
  21. 2024PDP: Physics-Based Character Animation via Diffusion Policycited by 31
  22. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  23. 2024EgoLM: Multi-Modal Language Model of Egocentric Motionscited by 28
  24. 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
  25. 2025UniPhys: Unified Planner and Controller with Diffusion for Flexible Physics-Based Character Controlcited by 25
  26. 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generationcited by 17
  27. 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactionscited by 11
  28. 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
  29. 2026Causal Motion Diffusion Models for Autoregressive Motion Generationcited by 10
  30. 2025Motion Synthesis with Sparse and Flexible Keyjoint Controlcited by 9
  31. 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modelingcited by 4

Built on by

Not cited yet.