mlsanityData to 14 Oct 2026

Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer

arXiv 2512.01061 ↗First posted 30 Nov 2025cs.RO cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

Recent progress in GPU-accelerated, photorealistic simulation has opened a scalable data-generation path for robot learning, where massive physics and visual randomization allow policies to generalize beyond curated environments. Building on these advances, we develop a teacher-student-bootstrap learning framework for vision-based humanoid loco-manipulation, using articulated-object interaction as a representative high-difficulty benchmark. Our approach introduces a staged-reset exploration strategy that stabilizes long-horizon privileged-policy training, and a GRPO-based fine-tuning procedure that mitigates partial observability and improves closed-loop consistency in sim-to-real RL. Trained entirely on simulation data, the resulting policy achieves robust zero-shot performance across diverse door types and outperforms human teleoperators by up to 31.7% in task completion time under the same whole-body control stack. This represents the first humanoid sim-to-real policy capable of diverse articulated loco-manipulation using pure RGB perception.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 46 of its 51 references that are in the map. First posted on arXiv 30 Nov 2025.

Builds on

46 of 51 references.

References · 46

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  4. 2019Solving Rubik's Cube with a Robot Handcited by 734
  5. 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
  6. 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
  7. 2018Residual Reinforcement Learning for Robot Controlcited by 274
  8. 2020First return, then explorecited by 266
  9. 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 233
  10. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
  11. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
  12. 2023Extreme Parkour with Legged Robotscited by 164
34 more
  1. 2022DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Realitycited by 149
  2. 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
  3. 2020Generalization in Reinforcement Learning by Soft Data Augmentationcited by 137
  4. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
  5. 2018Reinforcement and Imitation Learning for Diverse Visuomotor Skillscited by 126
  6. 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 123
  7. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 101
  8. 2024Humanoid Parkour Learningcited by 96
  9. 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 90
  10. 2025Self-Improving Vision-Language-Action Models with Data Generation via Residual RLcited by 78
  11. 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
  12. 2024UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllerscited by 75
  13. 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 62
  14. 2024WoCoCo: Learning Whole-Body Humanoid Control with Sequential Contactscited by 61
  15. 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 59
  16. 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 50
  17. 2025RSL-RL: A Learning Library for Robotics Researchcited by 49
  18. 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 46
  19. 2022Visual Reinforcement Learning with Self-Supervised 3D Representationscited by 45
  20. 2024DextrAH-RGB: Visuomotor Policies to Grasp Anything with Dexterous Handscited by 45
  21. 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instructioncited by 43
  22. 2024Learning to Manipulate Anywhere: A Visual Generalizable Framework For Reinforcement Learningcited by 41
  23. 2025HDMI: Learning Interactive Humanoid Whole-Body Control from Human Videoscited by 38
  24. 2023Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learningcited by 34
  25. 2024Adaptive Mobile Manipulation for Articulated Objects In the Open Worldcited by 31
  26. 2019DoorGym: A Scalable Door Opening Environment And Baseline Agentcited by 26
  27. 2024Learning Visual Parkour from Generated Imagescited by 18
  28. 2024Learning to Open and Traverse Doors with a Legged Manipulatorcited by 16
  29. 2025Procedural Generation of Articulated Simulation-Ready Assetscited by 11
  30. 2025VB-Com: Learning Vision-Blind Composite Humanoid Locomotion Against Deficient Perceptioncited by 10
  31. 2024RoboDuet: Learning a Cooperative Policy for Whole-body Legged Loco-Manipulationcited by 7
  32. 2025SIME: Enhancing Policy Self-Improvement with Modal-level Explorationcited by 7
  33. 2025StageACT: Stage-Conditioned Imitation for Robust Humanoid Door Openingcited by 3
  34. 2024A Behavior Architecture for Fast Humanoid Robot Door Traversalscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

  1. 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
  2. 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
  3. 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Datacited by 8
  4. 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learningcited by 5
  5. 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
  6. 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 3
  7. 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learningcited by 2
  8. 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting Worldcited by 2
  9. 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
  10. 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 1
  11. 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priorscited by 1
  12. 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worldscited by 1
3 more
  1. 2026MPC-Injection: Biasing Off-Policy Locomotion RL Toward Controller-Induced Behavior Basinscited by 1
  2. 2026Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperationcited by 0
  3. 2026An Empirical Study on What Matters for Viewpoint-Generalizable Policies in Visual Imitation Learningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulation
  2. 2026FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences
  3. 2025Learning Sim-to-Real Humanoid Locomotion in 15 Minutes
  4. 2025Accelerating Visual-Policy Learning through Parallel Differentiable Simulation
  5. 2025Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids
  6. 2025VR-Robo: A Real-to-Sim-to-Real Framework for Visual Robot Navigation and Locomotion
  7. 2026DreamControl-v2: Simpler and Scalable Autonomous Humanoid Skills via Trainable Guided Diffusion Priors
  8. 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning