mlsanityData to 14 Oct 2026

Learning Humanoid Navigation from Human Data

arXiv 2604.00416 ↗First posted 1 Apr 2026cs.RO cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present EgoNav, a system that enables a humanoid robot to traverse diverse, unseen environments by learning entirely from 5 hours of human walking data, with no robot data or finetuning. A diffusion model predicts distributions of plausible future trajectories conditioned on past trajectory, a 360 deg visual memory fusing color, depth, and semantics, and video features from a frozen DINOv3 backbone that capture appearance cues invisible to depth sensors. A hybrid sampling scheme achieves real-time inference in 10 denoising steps, and a receding-horizon controller selects paths from the predicted distribution. We validate EgoNav through offline evaluations, where it outperforms baselines in collision avoidance and multi-modal coverage, and through zero-shot deployment on a Unitree G1 humanoid across unseen indoor and outdoor environments. Behaviors such as waiting for doors to open, navigating around crowds, and avoiding glass walls emerge naturally from the learned prior. We will release the dataset and trained models. Our website: https://egonav.weizhuowang.com

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

36 of 47 references.

References · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2025DINOv3cited by 1,414
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  7. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
  8. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
  9. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
  10. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  11. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
  12. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
24 more
  1. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  2. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
  3. 2019Multiple Futures Predictioncited by 178
  4. 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
  5. 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 152
  6. 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 139
  7. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
  8. 2015Model Predictive Path Integral Control using Covariance Variable Importance Samplingcited by 124
  9. 2017InfoVAE: Information Maximizing Variational Autoencoderscited by 124
  10. 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
  11. 2024Humanoid Locomotion as Next Token Predictioncited by 69
  12. 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 64
  13. 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 51
  14. 2024Aria Everyday Activities Datasetcited by 39
  15. 2018Long-Term Occupancy Grid Prediction Using Recurrent Neural Networkscited by 29
  16. 2023Large Trajectory Models are Scalable Motion Predictors and Plannerscited by 23
  17. 2021Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusioncited by 17
  18. 2025Hand-Eye Autonomous Delivery: Learning Humanoid Navigation, Locomotion and Reachingcited by 12
  19. 2025LookOut: Real-World Humanoid Egocentric Navigationcited by 9
  20. 2025Robot Trains Robot: Automatic Real-World Policy Adaptation and Learning for Humanoidscited by 7
  21. 2025EgoCogNav: Cognition-aware Human Egocentric Navigationcited by 3
  22. 2022Trajectory and Sway Prediction Towards Fall Preventioncited by 2
  23. 2025Learning Predictive Visuomotor Coordinationcited by 2
  24. 2026Locomotion Beyond Feetcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PASSAGE: Scaling Scene-Aligned Motion Learning for Perceptive Humanoid Traversal in Cluttered Environments ↗
  2. 2026EgoActor: Grounding Task Planning into Spatial-aware Egocentric Actions for Humanoid Robots via Visual-Language Models
  3. 2024EgoNav: Egocentric Scene-aware Human Trajectory Prediction
  4. 2026HumanoidVLN: A Physics-Grounded Simulator and Benchmark for Vision-Language Navigation Across Diverse Humanoid Embodiments
  5. 2025EgoWalk: A Multimodal Dataset for Robot Navigation in the Wild
  6. 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots
  7. 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations
  8. 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model