Do You Have Freestyle? Expressive Humanoid Locomotion via Audio Control
Not on the map. Why?
Abstract (arXiv)
Humans intuitively move to sound, but current humanoid robots lack expressive improvisational capabilities, confined to predefined motions or sparse commands. Generating motion from audio and then retargeting it to robots relies on explicit motion reconstruction, leading to cascaded errors, high latency, and disjointed acoustic-actuation mapping. We propose RoboPerform, the first unified audio-to-locomotion framework that can directly generate music-driven dance and speech-driven co-speech gestures from audio. Guided by the core principle of "motion = content + style", the framework treats audio as implicit style signals and eliminates the need for explicit motion reconstruction. RoboPerform integrates a ResMoE teacher policy for adapting to diverse motion patterns and a diffusion-based student policy for audio style injection. This retargeting-free design ensures low latency and high fidelity. Experimental validation shows that RoboPerform achieves promising results in physical plausibility and audio alignment, successfully transforming robots into responsive performers capable of reacting to audio.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Dec 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Modelcited by 9
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulationcited by 5
- 2026Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulationcited by 4
- 2026Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recoverycited by 4
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Trackingcited by 2
- 2026Semantic Audio-driven Understanding for Dynamic Humanoid Whole Body Controlcited by 0
- 2026ECHO-G: Embodied Co-speech Humanoid mOtion Generationcited by 0
- 2026ECHO-G: Embodied Co-speech Humanoid mOtion Generation30 Sep 2026
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation6 Aug 2026
- 2026Semantic Audio-driven Understanding for Dynamic Humanoid Whole Body Control15 Jul 2026
- 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model2 May 2026
- 2026Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery2 May 2026
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking13 Mar 2026
- 2026Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulation4 Jan 2026