Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabulary
Not on the map. Why?
Abstract (arXiv)
Enabling humanoid robots to follow free-form natural language commands is a critical step toward seamless human-robot interaction and general-purpose embodied AI. However, existing methods remain limited, often constrained to simple instructions or forced to sacrifice motion diversity for physical plausibility. To address this gap, we present Humanoid-LLA, a Large Language Action model that translates unconstrained natural language directly into executable whole-body motions for humanoid robots. Our approach tackles two core challenges: paired language-humanoid motion data scarcity and physical instability. First, we bridge high-level language semantics with physically-grounded control by learning a unified human-humanoid motion vocabulary. Second, we introduce a novel two-stage fine-tuning framework that begins with supervised motion Chain-of-Thought learning, followed by reinforcement learning refined with physical feedback to ensure robustness and stability. Extensive evaluation in simulation and real-world cross-embodiment experiments demonstrates that Humanoid-LLA achieves superior generalization to novel language commands and diverse motion generation while maintaining high physical fidelity.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Modelcited by 3
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Trackingcited by 2
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcingcited by 1
- 2026From Scene-Centric to Observer-Centric: Modeling Observer-Aware Relations for 3D Scene Graph Generationcited by 0
- 2026What Language Does and What the Evidence Supports: A Functional Role Taxonomy and Evidence Audit of Language Grounding in Embodied Agentscited by 0
- 2026Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Trainingcited by 0
- 2026Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Training22 Sep 2026
- 2026What Language Does and What the Evidence Supports: A Functional Role Taxonomy and Evidence Audit of Language Grounding in Embodied Agents4 Aug 2026
- 2026From Scene-Centric to Observer-Centric: Modeling Observer-Aware Relations for 3D Scene Graph Generation25 Jun 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking13 Mar 2026
- 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Model28 Feb 2026
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions19 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learning
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Control
- 2024Grounding Language Models in Autonomous Loco-manipulation Tasks
- 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidance
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning
- 2025RL from Physical Feedback: Aligning Large Motion Models with Humanoid Control
- 2024Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Model