mlsanityData to 7 Oct 2026

ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control

arXiv 2603.16188 ↗First posted 17 Mar 2026cs.CVcited by 4

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

We present ECHO, an edge--cloud framework for language-driven whole-body control of humanoid robots. A cloud-hosted diffusion-based text-to-motion generator synthesizes motion references from natural language instructions, while an edge-deployed reinforcement-learning tracker executes them in closed loop on the robot. The two modules are bridged by a compact, robot-native 38-dimensional motion representation that encodes joint angles, root planar velocity, root height, and a continuous 6D root orientation per frame, eliminating inference-time retargeting from human body models and remaining directly compatible with low-level PD control. The generator adopts a 1D convolutional UNet with cross-attention conditioned on CLIP-encoded text features; at inference, DDIM sampling with 10 denoising steps and classifier-free guidance produces motion sequences in approximately one second on a cloud GPU. The tracker follows a Teacher--Student paradigm: a privileged teacher policy is distilled into a lightweight student equipped with an evidential adaptation module for sim-to-real transfer, further strengthened by morphological symmetry constraints and domain randomization. An autonomous fall recovery mechanism detects falls via onboard IMU readings and retrieves recovery trajectories from a pre-built motion library. We evaluate ECHO on a retargeted HumanML3D benchmark, where it achieves strong generation quality (FID 0.029, R-Precision Top-1 0.686) under a unified robot-domain evaluator, while maintaining high motion safety and trajectory consistency. Real-world experiments on a Unitree G1 humanoid demonstrate stable execution of diverse text commands with zero hardware fine-tuning.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 33 of its 42 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

33 of 42 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  7. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  8. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  9. 2022Human Motion Diffusion Modelcited by 1,062
  10. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  11. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  12. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
21 more
  1. 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 395
  2. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  3. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  4. 2019Deep Evidential Regressioncited by 354
  5. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  6. 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 202
  7. 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
  8. 2020Sim-to-Real Learning of All Common Bipedal Gaits via Periodic Reward Compositioncited by 71
  9. 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 48
  10. 2024DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Spacecited by 32
  11. 2024Leveraging Symmetry in RL-based Legged Locomotion Controlcited by 19
  12. 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 19
  13. 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 17
  14. 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
  15. 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
  16. 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
  17. 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8
  18. 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
  19. 2025Free-T2M: Robust Text-to-Motion Generation for Humanoid Robots via Frequency-Domaincited by 5
  20. 2025GentleHumanoid: Learning Upper-body Compliance for Contact-rich Human and Object Interactioncited by 5
  21. 2025LUMA: Low-Dimension Unified Motion Alignment with Dual-Path Anchoring for Text-to-Motion Diffusion Modelcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabulary
  2. 2026ADAPT: Agile Diffusion Action Priors for Robust and Steerable Online Text-Driven Humanoid Control ↗
  3. 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control
  4. 2025UniAct: Unified Motion Generation and Action Streaming for Humanoid Robots
  5. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
  6. 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction
  7. 2026TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation
  8. 2026ECHO-G: Embodied Co-speech Humanoid mOtion Generation