ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
We present ECHO, an edge--cloud framework for language-driven whole-body control of humanoid robots. A cloud-hosted diffusion-based text-to-motion generator synthesizes motion references from natural language instructions, while an edge-deployed reinforcement-learning tracker executes them in closed loop on the robot. The two modules are bridged by a compact, robot-native 38-dimensional motion representation that encodes joint angles, root planar velocity, root height, and a continuous 6D root orientation per frame, eliminating inference-time retargeting from human body models and remaining directly compatible with low-level PD control. The generator adopts a 1D convolutional UNet with cross-attention conditioned on CLIP-encoded text features; at inference, DDIM sampling with 10 denoising steps and classifier-free guidance produces motion sequences in approximately one second on a cloud GPU. The tracker follows a Teacher--Student paradigm: a privileged teacher policy is distilled into a lightweight student equipped with an evidential adaptation module for sim-to-real transfer, further strengthened by morphological symmetry constraints and domain randomization. An autonomous fall recovery mechanism detects falls via onboard IMU readings and retrieves recovery trajectories from a pre-built motion library. We evaluate ECHO on a retargeted HumanML3D benchmark, where it achieves strong generation quality (FID 0.029, R-Precision Top-1 0.686) under a unified robot-domain evaluator, while maintaining high motion safety and trajectory consistency. Real-world experiments on a Unitree G1 humanoid demonstrate stable execution of diverse text commands with zero hardware fine-tuning.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 33 of its 42 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
33 of 42 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
21 more
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 395
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2019Deep Evidential Regressioncited by 354
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 202
- 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
- 2020Sim-to-Real Learning of All Common Bipedal Gaits via Periodic Reward Compositioncited by 71
- 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 48
- 2024DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Spacecited by 32
- 2024Leveraging Symmetry in RL-based Legged Locomotion Controlcited by 19
- 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 19
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 17
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
- 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
- 2025Free-T2M: Robust Text-to-Motion Generation for Humanoid Robots via Frequency-Domaincited by 5
- 2025GentleHumanoid: Learning Upper-body Compliance for Contact-rich Human and Object Interactioncited by 5
- 2025LUMA: Low-Dimension Unified Motion Alignment with Dual-Path Anchoring for Text-to-Motion Diffusion Modelcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026PhysDrift: Bridging the Embodiment Gap in Humanoid Co-Speech Motion Generationcited by 3
- 2026Before the Body Moves: Learning Anticipatory Joint Intent for Language-Conditioned Humanoid Controlcited by 0
- 2026Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Trainingcited by 0
- 2026CSF: Contextual Safety Filtering for Motion Generatorscited by 0
- 2026CSF: Contextual Safety Filtering for Motion Generators8 Oct 2026
- 2026Sample, Simulate, Select: Physics-in-the-Loop Text-to-Motion for Humanoids Without Training22 Sep 2026
- 2026PhysDrift: Bridging the Embodiment Gap in Humanoid Co-Speech Motion Generation18 Jun 2026
- 2026Before the Body Moves: Learning Anticipatory Joint Intent for Language-Conditioned Humanoid Control14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabulary
- 2026ADAPT: Agile Diffusion Action Priors for Robust and Steerable Online Text-Driven Humanoid Control ↗
- 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control
- 2025UniAct: Unified Motion Generation and Action Streaming for Humanoid Robots
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction
- 2026TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation
- 2026ECHO-G: Embodied Co-speech Humanoid mOtion Generation