mlsanityData to 14 Oct 2026

MIND: Multi-Scale Intent Diffusion for Text-Driven Physics-Based Humanoid Control

arXiv 2605.26006 ↗First posted 25 May 2026cs.CV cs.GR cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

Enabling physics-based humanoids to execute diverse behaviors from high-level textual commands remains a significant challenge. Existing methods typically follow either a two-stage paradigm that combines kinematic motion generation with physics-based tracking, or an end-to-end imitation-learning paradigm that directly generates actions from text. However, the former suffers from the inherent domain shift between kinematic generation and physics-based tracking, while the latter struggles with the substantial modality gap between textual commands and low-level actions, limiting effective semantic alignment. Notably, humanoid states encode rich motion dynamics that are more semantically aligned with textual descriptions than low-level actions, making them a natural basis for deriving behavioral intent. Building upon this insight, we propose MIND, a novel end-to-end diffusion framework for text-driven physics-based humanoid control that leverages behavioral intent as a semantic bridge between textual commands and low-level actions. At its core, MIND introduces a multi-scale intent diffusion mechanism, where a holistic intent predictor captures global behavioral dynamics to guide overall behavior synthesis, while an immediate intent predictor provides step-wise, fine-grained signals for local behavior refinement at each diffusion step. This hierarchical intent formulation imposes a structured inductive bias for humanoid control, improving semantic alignment and behavioral naturalness. Furthermore, MIND encodes humanoid states into a latent space to enable more effective semantic intent modeling. Extensive experiments demonstrate that MIND outperforms existing methods and synthesizes coherent, physically plausible, and semantically aligned humanoid behaviors from text commands. Project page: https://binlee26.github.io/MIND_page.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 61 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

42 of 61 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  8. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  9. 2022Human Motion Diffusion Modelcited by 1,080
  10. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  11. 2022Mixture-of-Experts with Expert Choice Routingcited by 623
  12. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
30 more
  1. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  2. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  3. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
  4. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
  5. 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 116
  6. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 116
  7. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 109
  8. 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
  9. 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 94
  10. 2018GPU-Accelerated Robotic Simulation for Distributed Reinforcement Learningcited by 90
  11. 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillationcited by 89
  12. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  13. 2020Simple and Effective VAE Training with Calibrated Decoderscited by 57
  14. 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 55
  15. 2023PADL: Language-Directed Physics-Based Character Controlcited by 48
  16. 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
  17. 2025Diffusion Models for Robotic Manipulation: A Surveycited by 41
  18. 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
  19. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 37
  20. 2024PDP: Physics-Based Character Animation via Diffusion Policycited by 31
  21. 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 28
  22. 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 18
  23. 2024SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillationcited by 17
  24. 2025SMP: Reusable Score-Matching Motion Priors for Physics-Based Character Controlcited by 15
  25. 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
  26. 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
  27. 2026Causal Motion Diffusion Models for Autoregressive Motion Generationcited by 10
  28. 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
  29. 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphscited by 5
  30. 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Trackingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.