mlsanityData to 7 Oct 2026

HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining

arXiv 2606.20521 ↗First posted 18 Jun 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Embodied foundation models are expected to benefit from data scaling like large language models, but face a much tighter data bottleneck. Teleoperated real-robot trajectories remain the dominant pretraining source due to their precise action supervision and embodiment alignment, yet their scalability is limited by high collection cost, acquisition difficulty, and low behavioral and environmental diversity. These limitations have sparked interest in egocentric human video as a scalable, substantially lower-cost, and more diverse alternative for embodied model pretraining. However, its effectiveness compared to teleoperated real-robot data remains underexplored. To address this question, we conduct a systematic study comparing egocentric human video and teleoperated real-robot trajectories as pretraining data sources for embodied foundation models, under fixed post-training and validation protocols. Surprisingly, we find that egocentric data, when processed through a carefully designed filtering and labeling pipeline, is not merely a viable substitute for model pretraining but can lead to superior performance. With the same amount of pretraining data, models pretrained on egocentric data achieve a 24% lower validation loss on real-robot action prediction, as well as 52.5% and 90% higher success rates on in-distribution and out-of-distribution real-robot task execution, respectively. This finding verifies a scalable paradigm for embodied foundation models: pretrain on egocentric human video to learn diverse world representations, then adapt with a small amount of labeled real-robot data for action-space alignment. We hope this study encourages broader exploration of egocentric data and offers guidance for data quality assessment before costly robot data collection.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

32 of 38 references.

References · 32

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  6. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  7. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  8. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  9. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  10. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
  11. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  12. 2020Rescaling Egocentric Visioncited by 529
20 more
  1. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  2. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  3. 2026World Action Models are Zero-shot Policiescited by 411
  4. 2025Kimi-VL Technical Reportcited by 381
  5. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  6. 2026Causal World Modeling for Robot Controlcited by 289
  7. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  8. 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 160
  9. 2026A Pragmatic VLA Foundation Modelcited by 97
  10. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 94
  11. 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
  12. 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 77
  13. 2025Sekai: A Video Dataset towards World Explorationcited by 64
  14. 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
  15. 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 49
  16. 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
  17. 2025RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligencecited by 31
  18. 2026Rethinking Video Generation Model for the Embodied Worldcited by 30
  19. 2026HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videoscited by 14
  20. 2026HumanNet: Scaling Human-centric Video Learning to One Million Hourscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.