# LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learning

arXiv: https://arxiv.org/abs/2504.21738 · HTML: https://mlsanity.com/paper/2504.21738/

## Key facts

- Cited by 22 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Apr 2025.

## Built on by (most cited first, 22 of 22)

- [LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction](https://mlsanity.com/paper/2506.13751/) (2025)
- [From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidance](https://mlsanity.com/paper/2510.14952/) (2025)
- [HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videos](https://mlsanity.com/paper/2602.02473/) (2026)
- [TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control](https://mlsanity.com/paper/2602.07439/) (2026)
- [FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions](https://mlsanity.com/paper/2601.12799/) (2026)
- [ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data](https://mlsanity.com/paper/2603.09170/) (2026)
- [SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Control](https://mlsanity.com/paper/2511.19236/) (2025)
- [RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotion](https://mlsanity.com/paper/2512.23649/) (2025)
- [UniAct: Unified Motion Generation and Action Streaming for Humanoid Robots](https://mlsanity.com/paper/2512.24321/) (2025)
- [ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control](https://mlsanity.com/paper/2603.16188/) (2026)
- [SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating](https://mlsanity.com/paper/2603.23983/) (2026)
- [VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes](https://mlsanity.com/paper/2606.30645/) (2026)
- [PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking](https://mlsanity.com/paper/2603.19305/) (2026)
- [NFPO: Stabilized Policy Optimization of Normalizing Flow for Robotic Policy Learning](https://mlsanity.com/paper/2603.11470/) (2026)
- [Switch: Learning Agile Skills Switching for Humanoid Robots](https://mlsanity.com/paper/2604.14834/) (2026)
- [WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning](https://mlsanity.com/paper/2606.25591/) (2026)
- [AnyBody: Free-Form Whole-Body Humanoid Control from Arbitrary Keypoint Guidance](https://mlsanity.com/paper/2606.29209/) (2026)
- [MRBench: A Comprehensive Benchmark for Human Motion-Text Retrieval](https://mlsanity.com/paper/2608.07993/) (2026)
- [Discovering Self-Protective Falling Policy for Humanoid Robot via Deep Reinforcement Learning](https://mlsanity.com/paper/2512.01336/) (2025)
- [Before the Body Moves: Learning Anticipatory Joint Intent for Language-Conditioned Humanoid Control](https://mlsanity.com/paper/2605.14417/) (2026)
- [PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Control](https://mlsanity.com/paper/2609.24840/) (2026)
- [Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Training](https://mlsanity.com/paper/2609.26420/) (2026)

## Abstract (arXiv)

General-purpose humanoid robots are expected to interact intuitively with humans, enabling seamless integration into daily life. Natural language provides the most accessible medium for this purpose. However, translating language into humanoid whole-body motion remains a significant challenge, primarily due to the gap between linguistic understanding and physical actions. In this work, we present an end-to-end, language-directed policy for real-world humanoid whole-body control. Our approach combines reinforcement learning with policy distillation, allowing a single neural network to interpret language commands and execute corresponding physical actions directly. To enhance motion diversity and compositionality, we incorporate a Conditional Variational Autoencoder (CVAE) structure. The resulting policy achieves agile and versatile whole-body behaviors conditioned on language inputs, with smooth transitions between various motions, enabling adaptation to linguistic variations and the emergence of novel motions. We validate the efficacy and generalizability of our method through extensive simulations and real-world experiments, demonstrating robust whole-body control. Please see our website at LangWBC.github.io for more information.