mlsanityData to 7 Oct 2026

Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics

arXiv 2604.21017 ↗First posted 22 Apr 2026cs.RO cs.AIcited by 6

On the map: World models → Medical and surgical world models

Abstract (arXiv)

Autonomous medical robots hold promise to improve patient outcomes, reduce provider workload, democratize access to care, and enable superhuman precision. However, autonomous medical robotics has been limited by a fundamental data problem: existing medical robotic datasets are small, single-embodiment, and rarely shared openly, restricting the development of foundation models that the field needs to advance. We introduce Open-H-Embodiment, the largest open dataset of medical robotic video with synchronized kinematics to date, spanning more than 50 institutions and multiple robotic platforms including the CMR Versius, Intuitive Surgical's da Vinci, da Vinci Research Kit (dVRK), Rob Surgical BiTrack, Virtual Incision's MIRA, Moon Surgical Maestro, and a variety of custom systems, spanning surgical manipulation, robotic ultrasound, and endoscopy procedures. We demonstrate the research enabled by this dataset through two foundation models. GR00T-H is the first open foundation vision-language-action model for medical robotics, which is the only evaluated model to achieve full end-to-end task completion on a structured suturing benchmark (25% of trials vs. 0% for all others) and achieves 64% average success across a 29-step ex vivo suturing sequence. We also train Cosmos-H-Surgical-Simulator, the first action-conditioned world model to enable multi-embodiment surgical simulation from a single checkpoint, spanning nine robotic platforms and supporting in silico policy evaluation and synthetic data generation for the medical domain. These results suggest that open, large-scale medical robot data collection can serve as critical infrastructure for the research community, enabling advances in robot learning, world modeling, and beyond.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 13 of its 40 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

13 of 40 references.

References · 13

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  3. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  4. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  5. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  6. 2026World Action Models are Zero-shot Policiescited by 411
  7. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  8. 2026Causal World Modeling for Robot Controlcited by 289
  9. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  10. 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationcited by 125
  11. 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 108
  12. 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
1 more
  1. 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settingscited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024General-purpose foundation models for increased autonomy in robot-assisted surgery
  2. 2025Cosmos-H-Surgical: Learning Surgical Robot Policies from Videos via World Modeling
  3. 2025Cosmos-Surg-dVRK: World Foundation Model-based Automated Online Evaluation of Surgical Robot Policy Learning
  4. 2026SurgVLA-Bench: Towards Evaluating Vision-Language-Action Models for Laparoscopic Surgical Robotics
  5. 2026A vision-language model and platform for temporally mapping surgery from video
  6. 2025SurgXBench: Explainable Vision-Language Model Benchmark for Surgery
  7. 2026Surgical WAM: A World-Action Model for Data-Efficient Surgical Robot Learning
  8. 2026Imitation Learning for Robot Assistance in Open Surgery: A Multi-Policy Evaluation on Suture Following