Before the Body Moves: Learning Anticipatory Joint Intent for Language-Conditioned Humanoid Control
Not on the map. Why?
Abstract (arXiv)
Natural language is an intuitive interface for humanoid robots, yet streaming whole-body control requires control representations that are executable now and anticipatory of future physical transitions. Existing language-conditioned humanoid systems typically generate kinematic references that a low-level tracker must repair reactively, or use latent/action policies whose outputs do not explicitly encode upcoming contact changes, support transfers, and balance preparation. We propose DAJI (Dynamics-Aligned Joint Intent), a hierarchical framework that learns an anticipatory joint-intent interface between language generation and closed-loop control. DAJI-Act distills a future-aware teacher into a deployable diffusion action policy through student-driven rollouts, while DAJI-Flow autoregressively generates future intent chunks from language and intent history. Experiments show that DAJI achieves strong results in anticipatory latent learning, single-instruction generation, and streaming instruction following, reaching 94.42% rollout success on HumanML3D-style generation and 0.152 subsequence FID on BABEL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
36 of 47 references.
References · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
24 more
- 2016The KIT Motion-Language Datasetcited by 338
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 94
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
- 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 38
- 2024DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Spacecited by 34
- 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptionscited by 23
- 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 22
- 2024SATO: Stable Text-to-Motion Frameworkcited by 20
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 18
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2025Physics-Informed Representation Alignment for Sparse Radio-Map Reconstructioncited by 11
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
- 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8
- 2025Free-T2M: Robust Text-to-Motion Generation for Humanoid Robots via Frequency-Domaincited by 5
- 2025Text2Weight: Bridging Natural Language and Neural Network Weight Spacescited by 5
- 2026ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Controlcited by 4
- 2026Delta Score Matters! Spatial Adaptive Multi Guidance in Diffusion Modelscited by 4
- 2025LUMA: Low-Dimension Unified Motion Alignment with Dual-Path Anchoring for Text-to-Motion Diffusion Modelcited by 3
- 2026Oracle Noise: Faster Semantic Spherical Alignment for Interpretable Latent Optimizationcited by 2
- 2026RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoidscited by 1
Built on by
Not cited yet.