H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Large-scale manipulation data is essential for robot learning, yet collecting robot demonstrations remains expensive and difficult to scale. Meanwhile, abundant egocentric human manipulation videos provide rich behavioral experiences, but transferring them across embodiments remains challenging due to differences between human hands and robotic end-effectors. Recent advances in video world models offer a promising pathway to synthesize robot-centric manipulation videos from human observations, while their cross-embodiment transfer capability remains largely unexplored. Therefore, we introduce H2R-Bench, a benchmark for evaluating cross-embodiment human-to-robot manipulation video generation, where models transform egocentric human demonstrations into robot manipulation videos under specified embodiments. Each benchmark instance contains a human demonstration video, target embodiment constraints, and source-grounded annotations covering task goals, action events, functional contacts, and object responses. H2R-Bench evaluates generated videos through five dimensions, including goal-state completion, action-event completion, functional contact transfer, embodiment correctness, and general video quality. We benchmark eleven state-of-the-art video generation models across six manipulation families and two robot embodiments. Our evaluation reveals that current video world models remain limited in human-to-robot manipulation transfer: even leading models often fail in embodiment consistency, functional interaction, and task execution. H2R-Bench provides a systematic diagnostic framework for evaluating whether video world models can bridge the human-to-robot embodiment gap and convert human manipulation observations into robot-centric training resources.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 32 of its 69 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
32 of 69 references.
Closest ancestors · 2
Same direction, newest first
- 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation15 Jun
- 2026RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation1 Jun
Other references · 30
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
- 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Trainingcited by 384
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
- 2019AVID: Learning Multi-Stage Tasks via Pixel-Level Translation of Human Videoscited by 105
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 77
18 more
- 2025LongCat-Video Technical Reportcited by 73
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videoscited by 63
- 2025Kling-Omni Technical Reportcited by 60
- 2025Masquerade: Learning from In-the-wild Human Videos using Data-Editingcited by 38
- 2026Rethinking Video Generation Model for the Embodied Worldcited by 30
- 2025MimicDreamer: Aligning Human and Robot Demonstrations for Scalable VLA Trainingcited by 24
- 2025H2R: A Human-to-Robot Data Augmentation for Robot Pre-training from Videoscited by 21
- 2026SkyReels-V3 Technique Reportcited by 19
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
- 2025Mitty: Diffusion-based Human-to-Robot Video Generationcited by 13
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editingcited by 11
- 2025H2R-Grounder: A Paired-Data-Free Paradigm for Translating Human Interaction Videos into Physically Grounded Robot Videoscited by 8
- 2026Robot Learning from Human Videos: A Surveycited by 4
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Modelscited by 3
- 2026R3DP: Real-Time 3D-Aware Policy for Embodied Manipulationcited by 2
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoningcited by 2
- 2026CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editingcited by 1
- 2026RoboProcessBench: Benchmarking Process-Aware Understanding in Vision-Language Robotic Manipulationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generationcited by 0
- 2026HappyWorld-Benchcited by 0
- 2026HappyWorld-Bench21 Sep 2026
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation
- 2026Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation
- 2026Wh0: Generative World Models as Scalable Sources of Egocentric Human Hand Manipulation Data
- 2026Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
- 2025H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulation
- 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulation
- 2026IronMind: Scaling Humanoid Dexterous Manipulation via Camera-Space Ego-Centric Pretraining ↗