VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulation
Not on the map. Why?
Abstract (arXiv)
A key barrier to the real-world deployment of humanoid robots is the lack of autonomous loco-manipulation skills. We introduce VIRAL, a visual sim-to-real framework that learns humanoid loco-manipulation entirely in simulation and deploys it zero-shot to real hardware. VIRAL follows a teacher-student design: a privileged RL teacher, operating on full state, learns long-horizon loco-manipulation using a delta action space and reference state initialization. A vision-based student policy is then distilled from the teacher via large-scale simulation with tiled rendering, trained with a mixture of online DAgger and behavior cloning. We find that compute scale is critical: scaling simulation to tens of GPUs (up to 64) makes both teacher and student training reliable, while low-compute regimes often fail. To bridge the sim-to-real gap, VIRAL combines large-scale visual domain randomization over lighting, materials, camera parameters, image quality, and sensor delays--with real-to-sim alignment of the dexterous hands and cameras. Deployed on a Unitree G1 humanoid, the resulting RGB-based policy performs continuous loco-manipulation for up to 54 cycles, generalizing to diverse spatial and appearance variations without any real-world fine-tuning, and approaching expert-level teleoperation performance. Extensive ablations dissect the key design choices required to make RGB-based humanoid loco-manipulation work in practice.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Nov 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 25.
25 papers.
Sort:
By area:
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026Dex4D: Task-Agnostic Point Track Policy for Zero-Shot Dexterous Manipulationcited by 14
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
- 2026NavDreamer: Video Models as Zero-Shot 3D Navigatorscited by 9
- 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learningcited by 5
- 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Controlcited by 5
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisitioncited by 5
- 2026DeFM: Learning Foundation Representations from Depth for Roboticscited by 3
- 2026Learning Human-Like Badminton Skills for Humanoid Robotscited by 3
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 3
13 more
- 2026Scaling Sim-to-Real VLA Reinforcement Learning with Generative 3D Worldscited by 2
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting Worldcited by 2
- 2026Trust-Region Diffusion Policies for Massively Parallel On-Policy RLcited by 2
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 1
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priorscited by 1
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worldscited by 1
- 2026Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racingcited by 1
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactionscited by 1
- 2026Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representationcited by 0
- 2026VE2VF: Vision-Enabled to Vision-Free Distillation via Real-world Reinforcement Learning for Robust Contact-Rich Manipulationcited by 0
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoidscited by 0
- 2026A Balanced Data Diet: Addressing the Exploration Bottleneck in Mega-Scale RL for Robot Controlcited by 0
- 2026A Balanced Data Diet: Addressing the Exploration Bottleneck in Mega-Scale RL for Robot Control8 Oct 2026
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions15 Sep 2026
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoids14 Sep 2026
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulation22 Jun 2026
- 2026Trust-Region Diffusion Policies for Massively Parallel On-Policy RL13 Jun 2026
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisition10 Jun 2026
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World31 May 2026
- 2026VE2VF: Vision-Enabled to Vision-Free Distillation via Real-world Reinforcement Learning for Robust Contact-Rich Manipulation28 May 2026
- 2026Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation27 May 2026
- 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control21 May 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing10 Apr 2026
13 more
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds9 Apr 2026
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulation9 Apr 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
- 2026Scaling Sim-to-Real VLA Reinforcement Learning with Generative 3D Worlds19 Mar 2026
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors16 Mar 2026
- 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learning11 Mar 2026
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Grasping18 Feb 2026
- 2026Dex4D: Task-Agnostic Point Track Policy for Zero-Shot Dexterous Manipulation17 Feb 2026
- 2026NavDreamer: Video Models as Zero-Shot 3D Navigators10 Feb 2026
- 2026Learning Human-Like Badminton Skills for Humanoid Robots9 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations6 Feb 2026
- 2026DeFM: Learning Foundation Representations from Depth for Robotics26 Jan 2026
- 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learningcited by 5
- 2026Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racingcited by 1
- 2026VE2VF: Vision-Enabled to Vision-Free Distillation via Real-world Reinforcement Learning for Robust Contact-Rich Manipulationcited by 0
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoidscited by 0
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoids14 Sep 2026
- 2026VE2VF: Vision-Enabled to Vision-Free Distillation via Real-world Reinforcement Learning for Robust Contact-Rich Manipulation28 May 2026
- 2026Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing10 Apr 2026
- 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learning11 Mar 2026
- 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Controlcited by 5
- 2026Trust-Region Diffusion Policies for Massively Parallel On-Policy RLcited by 2
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priorscited by 1
- 2026Trust-Region Diffusion Policies for Massively Parallel On-Policy RL13 Jun 2026
- 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control21 May 2026
- 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors16 Mar 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026Dex4D: Task-Agnostic Point Track Policy for Zero-Shot Dexterous Manipulationcited by 14
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisitioncited by 5
- 2026DeFM: Learning Foundation Representations from Depth for Roboticscited by 3
- 2026Learning Human-Like Badminton Skills for Humanoid Robotscited by 3
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 3
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 1
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worldscited by 1
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactionscited by 1
12 most cited of 14 All 14 (JSON)
- 2026A Balanced Data Diet: Addressing the Exploration Bottleneck in Mega-Scale RL for Robot Control8 Oct 2026
- 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions15 Sep 2026
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulation22 Jun 2026
- 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisition10 Jun 2026
- 2026Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation27 May 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds9 Apr 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Grasping18 Feb 2026
- 2026Dex4D: Task-Agnostic Point Track Policy for Zero-Shot Dexterous Manipulation17 Feb 2026
- 2026Learning Human-Like Badminton Skills for Humanoid Robots9 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
12 newest of 14 All 14 (JSON)