Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer
Not on the map. Why?
Abstract (arXiv)
Recent progress in GPU-accelerated, photorealistic simulation has opened a scalable data-generation path for robot learning, where massive physics and visual randomization allow policies to generalize beyond curated environments. Building on these advances, we develop a teacher-student-bootstrap learning framework for vision-based humanoid loco-manipulation, using articulated-object interaction as a representative high-difficulty benchmark. Our approach introduces a staged-reset exploration strategy that stabilizes long-horizon privileged-policy training, and a GRPO-based fine-tuning procedure that mitigates partial observability and improves closed-loop consistency in sim-to-real RL. Trained entirely on simulation data, the resulting policy achieves robust zero-shot performance across diverse door types and outperforms human teleoperators by up to 31.7% in task completion time under the same whole-body control stack. This represents the first humanoid sim-to-real policy capable of diverse articulated loco-manipulation using pure RGB perception.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 46 of its 51 references that are in the map. First posted on arXiv 30 Nov 2025.
Builds on
46 of 51 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2019Solving Rubik's Cube with a Robot Handcited by 734
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
- 2018Residual Reinforcement Learning for Robot Controlcited by 274
- 2020First return, then explorecited by 266
- 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 233
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
- 2023Extreme Parkour with Legged Robotscited by 164
34 more
- 2022DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Realitycited by 149
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2020Generalization in Reinforcement Learning by Soft Data Augmentationcited by 137
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
- 2018Reinforcement and Imitation Learning for Diverse Visuomotor Skillscited by 126
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 123
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 101
- 2024Humanoid Parkour Learningcited by 96
- 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 90
- 2025Self-Improving Vision-Language-Action Models with Data Generation via Residual RLcited by 78
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2024UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllerscited by 75
- 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 62
- 2024WoCoCo: Learning Whole-Body Humanoid Control with Sequential Contactscited by 61
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 59
- 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 50
- 2025RSL-RL: A Learning Library for Robotics Researchcited by 49
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 46
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representationscited by 45
- 2024DextrAH-RGB: Visuomotor Policies to Grasp Anything with Dexterous Handscited by 45
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instructioncited by 43
- 2024Learning to Manipulate Anywhere: A Visual Generalizable Framework For Reinforcement Learningcited by 41
- 2025HDMI: Learning Interactive Humanoid Whole-Body Control from Human Videoscited by 38
- 2023Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learningcited by 34
- 2024Adaptive Mobile Manipulation for Articulated Objects In the Open Worldcited by 31
- 2019DoorGym: A Scalable Door Opening Environment And Baseline Agentcited by 26
- 2024Learning Visual Parkour from Generated Imagescited by 18
- 2024Learning to Open and Traverse Doors with a Legged Manipulatorcited by 16
- 2025Procedural Generation of Articulated Simulation-Ready Assetscited by 11
- 2025VB-Com: Learning Vision-Blind Composite Humanoid Locomotion Against Deficient Perceptioncited by 10
- 2024RoboDuet: Learning a Cooperative Policy for Whole-body Legged Loco-Manipulationcited by 7
- 2025SIME: Enhancing Policy Self-Improvement with Modal-level Explorationcited by 7
- 2025StageACT: Stage-Conditioned Imitation for Robust Humanoid Door Openingcited by 3
- 2024A Behavior Architecture for Fast Humanoid Robot Door Traversalscited by 2
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Datacited by 8
- 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learningcited by 5
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 3
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learningcited by 2
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting Worldcited by 2
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 1
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priorscited by 1
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worldscited by 1
3 more
- 2026MPC-Injection: Biasing Off-Policy Locomotion RL Toward Controller-Induced Behavior Basinscited by 1
- 2026Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperationcited by 0
- 2026An Empirical Study on What Matters for Viewpoint-Generalizable Policies in Visual Imitation Learningcited by 0
- 2026An Empirical Study on What Matters for Viewpoint-Generalizable Policies in Visual Imitation Learning26 Sep 2026
- 2026MPC-Injection: Biasing Off-Policy Locomotion RL Toward Controller-Induced Behavior Basins24 Jun 2026
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulation22 Jun 2026
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World31 May 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperation19 May 2026
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds9 Apr 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors16 Mar 2026
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning14 Mar 2026
- 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learning11 Mar 2026
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data10 Mar 2026
3 more
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Grasping18 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations6 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Datacited by 8
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 3
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 1
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worldscited by 1
- 2026Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperationcited by 0
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulation22 Jun 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperation19 May 2026
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds9 Apr 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data10 Mar 2026
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Grasping18 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations6 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulation
- 2026FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences
- 2025Learning Sim-to-Real Humanoid Locomotion in 15 Minutes
- 2025Accelerating Visual-Policy Learning through Parallel Differentiable Simulation
- 2025Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids
- 2025VR-Robo: A Real-to-Sim-to-Real Framework for Visual Robot Navigation and Locomotion
- 2026DreamControl-v2: Simpler and Scalable Autonomous Humanoid Skills via Trainable Guided Diffusion Priors
- 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning