Learning Humanoid Navigation from Human Data
Not on the map. Why?
Abstract (arXiv)
We present EgoNav, a system that enables a humanoid robot to traverse diverse, unseen environments by learning entirely from 5 hours of human walking data, with no robot data or finetuning. A diffusion model predicts distributions of plausible future trajectories conditioned on past trajectory, a 360 deg visual memory fusing color, depth, and semantics, and video features from a frozen DINOv3 backbone that capture appearance cues invisible to depth sensors. A hybrid sampling scheme achieves real-time inference in 10 denoising steps, and a receding-horizon controller selects paths from the predicted distribution. We validate EgoNav through offline evaluations, where it outperforms baselines in collision avoidance and multi-modal coverage, and through zero-shot deployment on a Unitree G1 humanoid across unseen indoor and outdoor environments. Behaviors such as waiting for doors to open, navigating around crowds, and avoiding glass walls emerge naturally from the learned prior. We will release the dataset and trained models. Our website: https://egonav.weizhuowang.com
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
36 of 47 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025DINOv3cited by 1,414
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
24 more
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2019Multiple Futures Predictioncited by 178
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
- 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 152
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 139
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2015Model Predictive Path Integral Control using Covariance Variable Importance Samplingcited by 124
- 2017InfoVAE: Information Maximizing Variational Autoencoderscited by 124
- 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
- 2024Humanoid Locomotion as Next Token Predictioncited by 69
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 64
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 51
- 2024Aria Everyday Activities Datasetcited by 39
- 2018Long-Term Occupancy Grid Prediction Using Recurrent Neural Networkscited by 29
- 2023Large Trajectory Models are Scalable Motion Predictors and Plannerscited by 23
- 2021Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusioncited by 17
- 2025Hand-Eye Autonomous Delivery: Learning Humanoid Navigation, Locomotion and Reachingcited by 12
- 2025LookOut: Real-World Humanoid Egocentric Navigationcited by 9
- 2025Robot Trains Robot: Automatic Real-World Policy Adaptation and Learning for Humanoidscited by 7
- 2025EgoCogNav: Cognition-aware Human Egocentric Navigationcited by 3
- 2022Trajectory and Sway Prediction Towards Fall Preventioncited by 2
- 2025Learning Predictive Visuomotor Coordinationcited by 2
- 2026Locomotion Beyond Feetcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PASSAGE: Scaling Scene-Aligned Motion Learning for Perceptive Humanoid Traversal in Cluttered Environments ↗
- 2026EgoActor: Grounding Task Planning into Spatial-aware Egocentric Actions for Humanoid Robots via Visual-Language Models
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Prediction
- 2026HumanoidVLN: A Physics-Grounded Simulator and Benchmark for Vision-Language Navigation Across Diverse Humanoid Embodiments
- 2025EgoWalk: A Multimodal Dataset for Robot Navigation in the Wild
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model