EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data
Not on the map. Why?
Cited by 23 in World models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Human behavior is among the most scalable sources of data for learning physical intelligence, yet how to effectively leverage it for dexterous manipulation remains unclear. While prior work demonstrates human to robot transfer in constrained settings, it is unclear whether large scale human data can support fine grained, high degree of freedom dexterous manipulation. We present EgoScale, a human to dexterous manipulation transfer framework built on large scale egocentric human data. We train a Vision Language Action (VLA) model on over 20,854 hours of action labeled egocentric human video, more than 20 times larger than prior efforts, and uncover a log linear scaling law between human data scale and validation loss. This validation loss strongly correlates with downstream real robot performance, establishing large scale human data as a predictable supervision source. Beyond scale, we introduce a simple two stage transfer recipe: large scale human pretraining followed by lightweight aligned human robot mid training. This enables strong long horizon dexterous manipulation and one shot task adaptation with minimal robot supervision. Our final policy improves average success rate by 54% over a no pretraining baseline using a 22 DoF dexterous robotic hand, and transfers effectively to robots with lower DoF hands, indicating that large scale human motion provides a reusable, embodiment agnostic motor prior.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Feb 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 77.
77 papers.
Sort:
By area:
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
- 2026EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Datacited by 17
- 2026HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videoscited by 14
- 2026RoboTTT: Context Scaling for Robot Policiescited by 13
- 2026Egocentric World Model for Photorealistic Hand-Object Interaction Synthesiscited by 10
- 2026T-Rex: Tactile-Reactive Dexterous Manipulationcited by 10
- 2026World Action Models: A Surveycited by 10
- 2026HumanNet: Scaling Human-centric Video Learning to One Million Hourscited by 9
- 2026Do as I Do: Dexterous Manipulation Data from Everyday Human Videoscited by 9
38 more
- 2026ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretrainingcited by 8
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 8
- 2026Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstrationcited by 6
- 2026WAM-TTT: Steering World-Action Models by Watching Human Play at Test Timecited by 6
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulationcited by 6
- 2026Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learningcited by 5
- 2026The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstructioncited by 4
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulationcited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editingcited by 4
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planningcited by 3
- 2026FACT: Failure-Aware Causal Training for World-Action Modelscited by 3
- 2026MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardwarecited by 2
- 2026EgoExo-WM: Unlocking Exo Video for Ego World Modelscited by 2
- 2026StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Videocited by 2
- 2026Ego-Pi: VLA Fine-Tuning for Ego-Centric Human and Robot Datacited by 2
- 2026HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretrainingcited by 2
- 2026Wh0: Generative World Models as Scalable Sources of Egocentric Human Hand Manipulation Datacited by 2
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Videocited by 2
- 2026EgoProceVQA: A Novel Egocentric Procedural Understanding Task with Self-Skill-Exploration Agentcited by 2
- 2026SiMDex: Mining Similar Egocentric Videos for Cross-Embodiment Dexterous Manipulationcited by 2
- 2026H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Modelscited by 2
- 2026EgoTac: In-the-wild Tactile Prediction from Egocentric Visioncited by 2
- 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Modelscited by 2
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 2
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worldscited by 1
- 2026ForgeVLA: Federated Vision-Language-Action Learning without Language Annotationscited by 1
- 2026Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?cited by 1
- 2026Not All Actions Are Equal: Rethinking Conditioning for Dexterous World Modelcited by 1
- 2026Translation as a Bridging Action: Transferring Manipulation Skills from Humans to Robotscited by 1
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policiescited by 1
- 2026A Minimalist Retargeting-Guided Reinforcement Learning Recipe for Dexterous Manipulationcited by 1
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understandingcited by 1
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 1
- 2026XPACE: Joint World and Action Modeling from Heterogeneous Experiencecited by 1
- 2026PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamicscited by 1
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulationcited by 1
- 2026EgoKit: Towards Unified Low-Cost Egocentric Data Collection with Heterogeneous Devicescited by 0
50 most cited of 77 All 77 (JSON)
- 2026What 30,000 Hours of Ego-centric Video Does Not Teach8 Oct 2026
- 2026VioLA: Learning Generalist Humanoid Control Policies from Human Data8 Oct 2026
- 2026TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learning7 Oct 2026
- 2026UniWAM: Unified World-Action Model1 Oct 2026
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026Ego4WAM: What Matters When Scaling Egocentric Human Data for Robot Learning?30 Sep 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026From Pixel to Poses: Object-centric Tool Manipulation Learning from Human Demonstrations28 Sep 2026
- 2026DexAgent: An Agentic Human2Sim2Robot Framework for Dexterous Manipulation with Self-Evolving Tool Library28 Sep 2026
- 2026From World Models to World Action Models: Rethinking Next-State Prediction28 Sep 2026
- 2026Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation28 Sep 2026
- 2026EgoSpeedUp: Transferring Human Manipulation Tempo to Robot Policies24 Sep 2026
38 more
- 2026CARF: Contrastive Attraction-Repulsion of Failure-Guided Flow Matching18 Sep 2026
- 2026Skel-WAM: A Hand-Skeleton-Conditioned World Action Model for Human-to-Robot Manipulation Transfer18 Sep 2026
- 2026AtomEgo: Exploring Ego-Robot Integration for Embodied Foundation Model Pretraining18 Sep 2026
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation16 Sep 2026
- 2026PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics16 Sep 2026
- 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware16 Sep 2026
- 2026XPACE: Joint World and Action Modeling from Heterogeneous Experience15 Sep 2026
- 2026MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild15 Sep 2026
- 2026Reconstructing Is Not Acting: Action-Centric Latent Dynamics Modeling14 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026HuRo: Robotizing Human Videos for Scalable VLA Pretraining9 Sep 2026
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training31 Aug 2026
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understanding31 Aug 2026
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation31 Aug 2026
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization26 Aug 2026
- 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models23 Aug 2026
- 2026Pre-training Visual Dexterity in Simulation16 Aug 2026
- 2026EgoTac: In-the-wild Tactile Prediction from Egocentric Vision15 Aug 2026
- 2026H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models13 Aug 2026
- 2026HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editing12 Aug 2026
- 2026FACT: Failure-Aware Causal Training for World-Action Models10 Aug 2026
- 2026SiMDex: Mining Similar Egocentric Videos for Cross-Embodiment Dexterous Manipulation4 Aug 2026
- 2026ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine30 Jul 2026
- 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer30 Jul 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026EgoRecovery: Acquiring Failure Recovery Ability Through Human Recovery Demonstration22 Jul 2026
- 2026Exo2EgoPose: Leveraging Exocentric Demonstrations for Vision-Language guided Egocentric 3D Hand Pose Forecasting17 Jul 2026
- 2026RoboTTT: Context Scaling for Robot Policies16 Jul 2026
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning15 Jul 2026
- 2026Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning15 Jul 2026
- 2026EgoProceVQA: A Novel Egocentric Procedural Understanding Task with Self-Skill-Exploration Agent15 Jul 2026
- 2026A Minimalist Retargeting-Guided Reinforcement Learning Recipe for Dexterous Manipulation13 Jul 2026
- 2026EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Data8 Jul 2026
- 2026WAM-TTT: Steering World-Action Models by Watching Human Play at Test Time8 Jul 2026
- 2026WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation7 Jul 2026
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies4 Jul 2026
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Video2 Jul 2026
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation1 Jul 2026
50 newest of 77 All 77 (JSON)
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2026EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Datacited by 17
- 2026Egocentric World Model for Photorealistic Hand-Object Interaction Synthesiscited by 10
- 2026World Action Models: A Surveycited by 10
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 8
- 2026WAM-TTT: Steering World-Action Models by Watching Human Play at Test Timecited by 6
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulationcited by 6
- 2026Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learningcited by 5
- 2026FACT: Failure-Aware Causal Training for World-Action Modelscited by 3
- 2026EgoExo-WM: Unlocking Exo Video for Ego World Modelscited by 2
- 2026Wh0: Generative World Models as Scalable Sources of Egocentric Human Hand Manipulation Datacited by 2
12 most cited of 23 All 23 (JSON)
- 2026UniWAM: Unified World-Action Model1 Oct 2026
- 2026From World Models to World Action Models: Rethinking Next-State Prediction28 Sep 2026
- 2026Skel-WAM: A Hand-Skeleton-Conditioned World Action Model for Human-to-Robot Manipulation Transfer18 Sep 2026
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation16 Sep 2026
- 2026PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics16 Sep 2026
- 2026XPACE: Joint World and Action Modeling from Heterogeneous Experience15 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training31 Aug 2026
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation31 Aug 2026
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization26 Aug 2026
- 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models23 Aug 2026
- 2026H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models13 Aug 2026
12 newest of 23 All 23 (JSON)
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
- 2026T-Rex: Tactile-Reactive Dexterous Manipulationcited by 10
- 2026ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretrainingcited by 8
- 2026ForgeVLA: Federated Vision-Language-Action Learning without Language Annotationscited by 1
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understandingcited by 1
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understanding31 Aug 2026
- 2026ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretraining15 Jun 2026
- 2026T-Rex: Tactile-Reactive Dexterous Manipulation15 Jun 2026
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments28 May 2026
- 2026ForgeVLA: Federated Vision-Language-Action Learning without Language Annotations8 May 2026
- 2026The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstructioncited by 4
- 2026StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Videocited by 2
- 2026CARF: Contrastive Attraction-Repulsion of Failure-Guided Flow Matchingcited by 0
- 2026CARF: Contrastive Attraction-Repulsion of Failure-Guided Flow Matching18 Sep 2026
- 2026The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstruction29 Jun 2026
- 2026StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video18 May 2026
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
- 2026HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videoscited by 14
- 2026RoboTTT: Context Scaling for Robot Policiescited by 13
- 2026HumanNet: Scaling Human-centric Video Learning to One Million Hourscited by 9
- 2026Do as I Do: Dexterous Manipulation Data from Everyday Human Videoscited by 9
- 2026Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstrationcited by 6
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulationcited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editingcited by 4
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planningcited by 3
- 2026MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardwarecited by 2
- 2026Ego-Pi: VLA Fine-Tuning for Ego-Centric Human and Robot Datacited by 2
12 most cited of 42 All 42 (JSON)
- 2026What 30,000 Hours of Ego-centric Video Does Not Teach8 Oct 2026
- 2026VioLA: Learning Generalist Humanoid Control Policies from Human Data8 Oct 2026
- 2026TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learning7 Oct 2026
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026Ego4WAM: What Matters When Scaling Egocentric Human Data for Robot Learning?30 Sep 2026
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation28 Sep 2026
- 2026AtomEgo: Exploring Ego-Robot Integration for Embodied Foundation Model Pretraining18 Sep 2026
- 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware16 Sep 2026
- 2026MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild15 Sep 2026
- 2026Reconstructing Is Not Acting: Action-Centric Latent Dynamics Modeling14 Sep 2026
- 2026HuRo: Robotizing Human Videos for Scalable VLA Pretraining9 Sep 2026
12 newest of 42 All 42 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026IronMind: Scaling Humanoid Dexterous Manipulation via Camera-Space Ego-Centric Pretraining ↗
- 2025In-N-On: Scaling Egocentric Manipulation with in-the-wild and on-task Data
- 2026Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
- 2026EgoSteer: An Open-Source Full-Stack System Towards Steerable Dexterous Manipulation from Egocentric Videos
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Video
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Video
- 2025METIS: Multi-Source Egocentric Training for Integrated Dexterous Vision-Language-Action Model
- 2025OpenEgo: A Large-Scale Multimodal Egocentric Dataset for Dexterous Manipulation