EgoPriMo: Egocentric Motion Generation for Interactive Humanoid Control
Not on the map. Why?
Abstract (arXiv)
Humanoid robots require whole-body motions that adapt to scene context, task requirements, and user intent. Motion tracking reproduces specified trajectories, and humanoid vision-language-action systems provide semantic interfaces, but neither offers a scalable and interactive prior for broad full-body behavior. We introduce EgoPriMo (Egocentric Motion Prior for Humanoid Robots), a unified framework that learns such priors from egocentric human demonstrations. Given egocentric observations and a text prompt, EgoPriMo reconstructs, generates, and forecasts SMPL-based full-body motion. Language is used as a high-level control signal rather than a complete motion specification. At the core of EgoPriMo is a Triple-stream DiT that jointly models body dynamics, egocentric visual context, and text; task-conditioning masks route different tasks and missing-modality data through the same checkpoint. Experiments on Nymeria and EgoExo4D show that one checkpoint improves egocentric motion generation over UniEgoMotion while supporting reconstruction and forecasting; the generated SMPL motions can also be executed by a Unitree humanoid controller. These results indicate a practical path from scalable egocentric observations to generalizable and interactive humanoid motion priors.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 38 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
35 of 38 references.
References · 35
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
23 more
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 93
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 76
- 2022Correcting Robot Plans with Natural Language Feedbackcited by 68
- 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 56
- 2025VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generationcited by 21
- 2024Trajectory Improvement and Reward Learning from Comparative Language Feedbackcited by 17
- 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generationcited by 17
- 2025EgoMI: Learning Active Vision and Whole-Body Manipulation from Egocentric Human Demonstrationscited by 12
- 2026FlowCorrect: Efficient Interactive Correction of Generative Flow Policies for Robotic Manipulationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026EgoActor: Grounding Task Planning into Spatial-aware Egocentric Actions for Humanoid Robots via Visual-Language Models
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data
- 2026Towards a General Humanoid Loco-Manipulation Model via Egocentric Whole-Body Human Data Pretraining ↗
- 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstration
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation
- 2025PhysBrain: Human Egocentric Data as a Bridge from Vision Language Models to Physical Intelligence
- 2026EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning
- 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integration