GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction
On the map: World models → Humanoid and legged locomotion world models
Abstract (arXiv)
General-purpose motion trackers enable humanoid robots to follow diverse whole-body motions while maintaining balance, but are trained only on flat ground, failing to exploit bipedal mobility over complex terrain. Cross-terrain controllers, meanwhile, are task-specific or accept only low-dimensional locomotion commands. We introduce InterTrack, the first behavior world model (BWM) for robust whole-body tracking with environment interaction. Its Transformer jointly predicts the next action, state, and behavior distribution, learning environment-conditioned dynamics. To scale interaction training data, an automatic annotation pipeline reconstructs 3D support geometry from retargeted motions. At deployment, the policy handles commands implausible in the current environment in a "best-effort" manner. Quantitatively, InterTrack achieves an 81.3% success rate on terrain interaction (4.3 times the best evaluated baseline) and a 99.3% fall-recovery rate, while also improving free-space tracking and outperforming three leading tracking baselines across all of these regimes. To our knowledge, we provide the first demonstration of real-time cross-terrain whole-body teleoperation on a humanoid robot, alongside object interaction, stable responses to missing supports, and robust recovery from falls.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Humanoid and legged locomotion world models, one of 11 directions in World models. Builds on 38 of its 58 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
38 of 58 references.
References · 38
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 65
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 57
- 2024WoCoCo: Learning Whole-Body Humanoid Control with Sequential Contactscited by 49
- 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection Systemcited by 39
26 more
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 34
- 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 34
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 34
- 2025BFM-Zero: A Promptable Behavioral Foundation Model for Humanoid Control Using Unsupervised Reinforcement Learningcited by 33
- 2025Track Any Motions under Any Disturbancescited by 32
- 2025HDMI: Learning Interactive Humanoid Whole-Body Control from Human Videoscited by 32
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 16
- 2025Behavior Foundation Model for Humanoid Robotscited by 15
- 2025Isaac Lab: A GPU-Accelerated Simulation Framework for Multi-Modal Robot Learningcited by 14
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 13
- 2026OmniXtreme: Breaking the Generality Barrier in High-Dynamic Humanoid Controlcited by 13
- 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Controlcited by 11
- 2026Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoidscited by 11
- 2025Gallant: Voxel Grid-based Humanoid Locomotion and Local-navigation across 3D Constrained Terrainscited by 10
- 2026Learning Whole-Body Humanoid Locomotion via Motion Generation and Motion Trackingcited by 9
- 2026HoloMotion-1 Technical Reportcited by 8
- 2025A Survey of Behavior Foundation Model: Next-Generation Whole-Body Control System of Humanoid Robotscited by 7
- 2026RPL: Learning Robust Humanoid Perceptive Locomotion on Challenging Terrainscited by 6
- 2025SafeFall: Learning Protective Control for Humanoid Robotscited by 5
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbationcited by 5
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstructioncited by 5
- 2026Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Trackingcited by 4
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026Agile and Generalized Legged Locomotion via Attention-Based Neural Map Encodingcited by 3
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projectioncited by 1
- 2026Perceptive Behavior Foundation Model: Adapting Human Motion Priors to Robot-Centric Terraincited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026BRACE: Adapting Whole-Body References for Force and Terrain Aware Humanoid Motion Tracking ↗
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
- 2026PASSAGE: Scaling Scene-Aligned Motion Learning for Perceptive Humanoid Traversal in Cluttered Environments ↗
- 2026WholeBodyWAM: Generalizing Pre-trained World-Action Priors to Humanoid Loco-Manipulation via WBC-Grounded Coordination
- 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllers
- 2025DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion
- 2026KPI: A Promptable Kernel for Physical Interaction on Humanoids ↗
- 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning