Free-T2M: Robust Text-to-Motion Generation for Humanoid Robots via Frequency-Domain
Not on the map. Why?
Abstract (arXiv)
Enabling humanoid robots to synthesize complex, physically coherent motions from natural language commands is a cornerstone of autonomous robotics and human-robot interaction. While diffusion models have shown promise in this text-to-motion (T2M) task, they often generate semantically flawed or unstable motions, limiting their applicability to real-world robots. This paper reframes the T2M problem from a frequency-domain perspective, revealing that the generative process mirrors a hierarchical control paradigm. We identify two critical phases: a semantic planning stage, where low-frequency components establish the global motion trajectory, and a fine-grained execution stage, where high-frequency details refine the movement. To address the distinct challenges of each phase, we introduce Frequency enhanced text-to-motion (Free-T2M), a framework incorporating stage-specific frequency-domain consistency alignment. We design a frequency-domain temporal-adaptive module to modulate the alignment effects of different frequency bands. These designs enforce robustness in the foundational semantic plan and enhance the accuracy of detailed execution. Extensive experiments show our method dramatically improves motion quality and semantic correctness. Notably, when applied to the StableMoFusion baseline, Free-T2M reduces the FID from 0.152 to 0.060, establishing a new state-of-the-art within diffusion architectures. These findings underscore the critical role of frequency-domain insights for generating robust and reliable motions, paving the way for more intuitive natural language control of robots.
Key facts. Cited by 5 papers in the map (data through 13 Oct 2026). Builds on 33 of its 40 references that are in the map. First posted on arXiv 30 Jan 2025.
Builds on
33 of 40 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,550
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,213
- 2022Human Motion Diffusion Modelcited by 1,067
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 775
- 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 745
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 583
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 572
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 525
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 396
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
21 more
- 2016The KIT Motion-Language Datasetcited by 337
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 285
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 222
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 213
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 167
- 2023MMM: Generative Masked Motion Modelcited by 130
- 2023AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkerscited by 112
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 111
- 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 54
- 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
- 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 48
- 2022Surface Reconstruction from Point Clouds: A Survey and a Benchmarkcited by 41
- 2024DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Spacecited by 33
- 2024A Survey of Robotic Language Grounding: Tradeoffs between Symbols and Embeddingscited by 24
- 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptionscited by 22
- 2024SATO: Stable Text-to-Motion Frameworkcited by 20
- 2024Autonomous LLM-Enhanced Adversarial Attack for Text-to-Motioncited by 7
- 2024COAST: Constraints and Streams for Task and Motion Planningcited by 6
- 2024Efficient Text-driven Motion Generation via Latent Consistency Trainingcited by 5
- 2024Infinite Motion: Extended Motion Generation via Long Text Instructionscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
- 2026ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Controlcited by 4
- 2025LUMA: Low-Dimension Unified Motion Alignment with Dual-Path Anchoring for Text-to-Motion Diffusion Modelcited by 3
- 2026MemoGen: Can Past Experience Improve Future Text-to-Image Generation?cited by 3
- 2026Before the Body Moves: Learning Anticipatory Joint Intent for Language-Conditioned Humanoid Controlcited by 0
- 2026MemoGen: Can Past Experience Improve Future Text-to-Image Generation?2 Jun 2026
- 2026Before the Body Moves: Learning Anticipatory Joint Intent for Language-Conditioned Humanoid Control14 May 2026
- 2026ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control17 Mar 2026
- 2025LUMA: Low-Dimension Unified Motion Alignment with Dual-Path Anchoring for Text-to-Motion Diffusion Model29 Sep 2025
- 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Model3 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabulary
- 2025Semantic Co-Speech Gesture Synthesis and Real-Time Control for Humanoid Robots ↗
- 2026TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidance
- 2026ADAPT: Agile Diffusion Action Priors for Robust and Steerable Online Text-Driven Humanoid Control ↗
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions
- 2026RoboGesture: Real-Time Semantic-aligned Co-Speech Gestures Generation for Humanoid Interaction
- 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control