mlsanityData to 14 Oct 2026

VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulation

arXiv 2511.15200 ↗First posted 19 Nov 2025cs.ROcited by 25

Not on the map. Why?

Abstract (arXiv)

A key barrier to the real-world deployment of humanoid robots is the lack of autonomous loco-manipulation skills. We introduce VIRAL, a visual sim-to-real framework that learns humanoid loco-manipulation entirely in simulation and deploys it zero-shot to real hardware. VIRAL follows a teacher-student design: a privileged RL teacher, operating on full state, learns long-horizon loco-manipulation using a delta action space and reference state initialization. A vision-based student policy is then distilled from the teacher via large-scale simulation with tiled rendering, trained with a mixture of online DAgger and behavior cloning. We find that compute scale is critical: scaling simulation to tens of GPUs (up to 64) makes both teacher and student training reliable, while low-compute regimes often fail. To bridge the sim-to-real gap, VIRAL combines large-scale visual domain randomization over lighting, materials, camera parameters, image quality, and sensor delays--with real-to-sim alignment of the dexterous hands and cameras. Deployed on a Unitree G1 humanoid, the resulting RGB-based policy performs continuous loco-manipulation for up to 54 cycles, generalizing to diverse spatial and appearance variations without any real-world fine-tuning, and approaching expert-level teleoperation performance. Extensive ablations dissect the key design choices required to make RGB-based humanoid loco-manipulation work in practice.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Nov 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 25.

25 papers.

Sort:

By area:

  1. 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
  2. 2026Dex4D: Task-Agnostic Point Track Policy for Zero-Shot Dexterous Manipulationcited by 14
  3. 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
  4. 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
  5. 2026NavDreamer: Video Models as Zero-Shot 3D Navigatorscited by 9
  6. 2026SteadyTray: Learning Object Balancing Tasks in Humanoid Tray Transport via Residual Reinforcement Learningcited by 5
  7. 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Controlcited by 5
  8. 2026LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisitioncited by 5
  9. 2026DeFM: Learning Foundation Representations from Depth for Roboticscited by 3
  10. 2026Learning Human-Like Badminton Skills for Humanoid Robotscited by 3
  11. 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
  12. 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 3
13 more
  1. 2026Scaling Sim-to-Real VLA Reinforcement Learning with Generative 3D Worldscited by 2
  2. 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting Worldcited by 2
  3. 2026Trust-Region Diffusion Policies for Massively Parallel On-Policy RLcited by 2
  4. 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
  5. 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 1
  6. 2026ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priorscited by 1
  7. 2026SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worldscited by 1
  8. 2026Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racingcited by 1
  9. 2026Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactionscited by 1
  10. 2026Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representationcited by 0
  11. 2026VE2VF: Vision-Enabled to Vision-Free Distillation via Real-world Reinforcement Learning for Robust Contact-Rich Manipulationcited by 0
  12. 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoidscited by 0
  13. 2026A Balanced Data Diet: Addressing the Exploration Bottleneck in Mega-Scale RL for Robot Controlcited by 0