MIND: Multi-Scale Intent Diffusion for Text-Driven Physics-Based Humanoid Control
Not on the map. Why?
Abstract (arXiv)
Enabling physics-based humanoids to execute diverse behaviors from high-level textual commands remains a significant challenge. Existing methods typically follow either a two-stage paradigm that combines kinematic motion generation with physics-based tracking, or an end-to-end imitation-learning paradigm that directly generates actions from text. However, the former suffers from the inherent domain shift between kinematic generation and physics-based tracking, while the latter struggles with the substantial modality gap between textual commands and low-level actions, limiting effective semantic alignment. Notably, humanoid states encode rich motion dynamics that are more semantically aligned with textual descriptions than low-level actions, making them a natural basis for deriving behavioral intent. Building upon this insight, we propose MIND, a novel end-to-end diffusion framework for text-driven physics-based humanoid control that leverages behavioral intent as a semantic bridge between textual commands and low-level actions. At its core, MIND introduces a multi-scale intent diffusion mechanism, where a holistic intent predictor captures global behavioral dynamics to guide overall behavior synthesis, while an immediate intent predictor provides step-wise, fine-grained signals for local behavior refinement at each diffusion step. This hierarchical intent formulation imposes a structured inductive bias for humanoid control, improving semantic alignment and behavioral naturalness. Furthermore, MIND encodes humanoid states into a latent space to enable more effective semantic intent modeling. Extensive experiments demonstrate that MIND outperforms existing methods and synthesizes coherent, physically plausible, and semantically aligned humanoid behaviors from text commands. Project page: https://binlee26.github.io/MIND_page.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 61 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
42 of 61 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2022Mixture-of-Experts with Expert Choice Routingcited by 623
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
30 more
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 116
- 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 116
- 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 109
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 94
- 2018GPU-Accelerated Robotic Simulation for Distributed Reinforcement Learningcited by 90
- 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillationcited by 89
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2020Simple and Effective VAE Training with Calibrated Decoderscited by 57
- 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 55
- 2023PADL: Language-Directed Physics-Based Character Controlcited by 48
- 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
- 2025Diffusion Models for Robotic Manipulation: A Surveycited by 41
- 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
- 2026Kimodo: Scaling Controllable Human Motion Generationcited by 37
- 2024PDP: Physics-Based Character Animation via Diffusion Policycited by 31
- 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 28
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 18
- 2024SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillationcited by 17
- 2025SMP: Reusable Score-Matching Motion Priors for Physics-Based Character Controlcited by 15
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generationcited by 10
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
- 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphscited by 5
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Trackingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.