mlsanityData to 7 Oct 2026

EgoPriMo: Egocentric Motion Generation for Interactive Humanoid Control

arXiv 2606.08495 ↗First posted 7 Jun 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Humanoid robots require whole-body motions that adapt to scene context, task requirements, and user intent. Motion tracking reproduces specified trajectories, and humanoid vision-language-action systems provide semantic interfaces, but neither offers a scalable and interactive prior for broad full-body behavior. We introduce EgoPriMo (Egocentric Motion Prior for Humanoid Robots), a unified framework that learns such priors from egocentric human demonstrations. Given egocentric observations and a text prompt, EgoPriMo reconstructs, generates, and forecasts SMPL-based full-body motion. Language is used as a high-level control signal rather than a complete motion specification. At the core of EgoPriMo is a Triple-stream DiT that jointly models body dynamics, egocentric visual context, and text; task-conditioning masks route different tasks and missing-modality data through the same checkpoint. Experiments on Nymeria and EgoExo4D show that one checkpoint improves egocentric motion generation over UniEgoMotion while supporting reconstruction and forecasting; the generated SMPL motions can also be executed by a Unitree humanoid controller. These results indicate a practical path from scalable egocentric observations to generalizable and interactive humanoid motion priors.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 38 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

35 of 38 references.

References · 35

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  5. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  6. 2022Human Motion Diffusion Modelcited by 1,062
  7. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  8. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  9. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  10. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  11. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  12. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
23 more
  1. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  2. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  3. 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
  4. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  5. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
  6. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
  7. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
  8. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  9. 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
  10. 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
  11. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
  12. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109
  13. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
  14. 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 93
  15. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
  16. 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 76
  17. 2022Correcting Robot Plans with Natural Language Feedbackcited by 68
  18. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 56
  19. 2025VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generationcited by 21
  20. 2024Trajectory Improvement and Reward Learning from Comparative Language Feedbackcited by 17
  21. 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generationcited by 17
  22. 2025EgoMI: Learning Active Vision and Whole-Body Manipulation from Egocentric Human Demonstrationscited by 12
  23. 2026FlowCorrect: Efficient Interactive Correction of Generative Flow Policies for Robotic Manipulationcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EgoActor: Grounding Task Planning into Spatial-aware Egocentric Actions for Humanoid Robots via Visual-Language Models
  2. 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data
  3. 2026Towards a General Humanoid Loco-Manipulation Model via Egocentric Whole-Body Human Data Pretraining ↗
  4. 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstration
  5. 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation
  6. 2025PhysBrain: Human Egocentric Data as a Bridge from Vision Language Models to Physical Intelligence
  7. 2026EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning
  8. 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integration