Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulation
Not on the map. Why?
Abstract (arXiv)
We introduce Psi0 (Psi-Zero), an open foundation model to address challenging humanoid loco-manipulation tasks. While existing approaches often attempt to address this fundamental problem by co-training on large and diverse human and humanoid data, we argue that this strategy is suboptimal due to the fundamental kinematic and motion disparities between humans and humanoid robots. Therefore, data efficiency and model performance remain unsatisfactory despite the considerable data volume. To address this challenge, ours;decouples the learning process to maximize the utility of heterogeneous data sources. Specifically, we propose a staged training paradigm with different learning objectives: First, we autoregressively pre-train a VLM backbone on large-scale egocentric human videos to acquire generalizable visual-action representations. Then, we post-train a flow-based action expert on high-quality humanoid robot data to learn precise robot joint control. Our research further identifies a critical yet often overlooked data recipe: in contrast to approaches that scale with noisy Internet clips or heterogeneous cross-embodiment robot datasets, we demonstrate that pre-training on high-quality egocentric human manipulation data followed by post-training on domain-specific real-world humanoid trajectories yields superior performance. Extensive real-world experiments demonstrate that ours achieves the best performance using only about 800 hours of human video data and 30 hours of real-world robot data, outperforming baselines pre-trained on more than 10× as much data by over 40% in overall success rate across multiple tasks. We will open-source the entire ecosystem to the community, including a data processing and training pipeline, a humanoid foundation model, and a real-time action inference engine.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 25.
25 papers.
Sort:
By area:
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulationcited by 8
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulationcited by 5
- 2026Fast SAM 3D Body: Accelerating SAM 3D Body for Real-Time Full-Body Human Mesh Recoverycited by 4
- 2026ActiveMimic: Egocentric Video Pretraining with Active Perceptioncited by 4
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 4
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026VLALeaks: Membership Inference Attacks against Vision-Language-Action Modelscited by 2
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 2
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 1
- 2026CLIFT: Turning Gemini Robotics On-Device into Humanoid Specialists via Non-Invasive Closed-Loop Iterative Fine-Tuningcited by 1
- 2026HAF: Adapting Generalist VLAs to Humanoid Whole-Body Loco-manipulation via Hierarchical Action Flow and Spectral Latent RLcited by 1
13 more
- 2026Rolling-WAM: World Action Models with Rolling Imaginationcited by 1
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting Worldcited by 0
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teacherscited by 0
- 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Modelscited by 0
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Modelcited by 0
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactionscited by 0
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaborationcited by 0
- 2026Humanoid Loco-Manipulation With Discrete VLA Modelcited by 0
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulationcited by 0
- 2026HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Executioncited by 0
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robotscited by 0
- 2026LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homescited by 0
- 2026VioLA: Learning Generalist Humanoid Control Policies from Human Datacited by 0
- 2026VioLA: Learning Generalist Humanoid Control Policies from Human Data8 Oct 2026
- 2026LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes8 Oct 2026
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots8 Oct 2026
- 2026HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Execution1 Oct 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026Humanoid Loco-Manipulation With Discrete VLA Model28 Sep 2026
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaboration28 Sep 2026
- 2026Rolling-WAM: World Action Models with Rolling Imagination24 Sep 2026
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions15 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Models24 Aug 2026
- 2026HAF: Adapting Generalist VLAs to Humanoid Whole-Body Loco-manipulation via Hierarchical Action Flow and Spectral Latent RL17 Aug 2026
13 more
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation6 Aug 2026
- 2026CLIFT: Turning Gemini Robotics On-Device into Humanoid Specialists via Non-Invasive Closed-Loop Iterative Fine-Tuning31 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun 2026
- 2026VLALeaks: Membership Inference Attacks against Vision-Language-Action Models13 Jun 2026
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation8 Jun 2026
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers4 Jun 2026
- 2026ActiveMimic: Egocentric Video Pretraining with Active Perception4 Jun 2026
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World31 May 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr 2026
- 2026Fast SAM 3D Body: Accelerating SAM 3D Body for Real-Time Full-Body Human Mesh Recovery16 Mar 2026
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 4
- 2026VLALeaks: Membership Inference Attacks against Vision-Language-Action Modelscited by 2
- 2026HAF: Adapting Generalist VLAs to Humanoid Whole-Body Loco-manipulation via Hierarchical Action Flow and Spectral Latent RLcited by 1
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting Worldcited by 0
- 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Modelscited by 0
- 2026Humanoid Loco-Manipulation With Discrete VLA Modelcited by 0
- 2026Humanoid Loco-Manipulation With Discrete VLA Model28 Sep 2026
- 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Models24 Aug 2026
- 2026HAF: Adapting Generalist VLAs to Humanoid Whole-Body Loco-manipulation via Hierarchical Action Flow and Spectral Latent RL17 Aug 2026
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun 2026
- 2026VLALeaks: Membership Inference Attacks against Vision-Language-Action Models13 Jun 2026
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World31 May 2026
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulationcited by 8
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulationcited by 5
- 2026Rolling-WAM: World Action Models with Rolling Imaginationcited by 1
- 2026Rolling-WAM: World Action Models with Rolling Imagination24 Sep 2026
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation6 Aug 2026
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation8 Jun 2026
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr 2026
- 2026Fast SAM 3D Body: Accelerating SAM 3D Body for Real-Time Full-Body Human Mesh Recoverycited by 4
- 2026ActiveMimic: Egocentric Video Pretraining with Active Perceptioncited by 4
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 2
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 1
- 2026CLIFT: Turning Gemini Robotics On-Device into Humanoid Specialists via Non-Invasive Closed-Loop Iterative Fine-Tuningcited by 1
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Modelcited by 0
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactionscited by 0
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaborationcited by 0
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulationcited by 0
- 2026HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Executioncited by 0
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robotscited by 0
12 most cited of 14 All 14 (JSON)
- 2026VioLA: Learning Generalist Humanoid Control Policies from Human Data8 Oct 2026
- 2026LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes8 Oct 2026
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots8 Oct 2026
- 2026HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Execution1 Oct 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaboration28 Sep 2026
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions15 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026CLIFT: Turning Gemini Robotics On-Device into Humanoid Specialists via Non-Invasive Closed-Loop Iterative Fine-Tuning31 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026ActiveMimic: Egocentric Video Pretraining with Active Perception4 Jun 2026
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026WB-WAM: Heterogeneous Body-Hand Pre-training for Humanoid Loco-Manipulation ↗
- 2026Towards a General Humanoid Loco-Manipulation Model via Egocentric Whole-Body Human Data Pretraining ↗
- 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Control
- 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstration
- 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
- 2026DreamControl-v2: Simpler and Scalable Autonomous Humanoid Skills via Trainable Guided Diffusion Priors
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning
- 2026FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences ↗