Plan, Don't Pose: Long Composite Motion Generation with Text-Aligned BFM
Not on the map. Why?
Abstract (arXiv)
Text-to-motion (T2M) generation has broad applications in character animation, virtual avatars, and human-robot interaction. Existing methods typically generate pose trajectories or motion tokens directly from language, forcing a single model to handle semantic interpretation, long-horizon structure, and low-level physical realization. This coupling makes them costly and often unreliable for long, compositional, or semantically dense prompts. We propose Text2BFM, the first framework that aligns natural language with pretrained Behavioral Foundation Models (BFMs) for T2M generation without relying on heavy end-to-end motion generators. Text2BFM operates in the latent policy space of a frozen BFM, using it as an executable motion prior. A text-aligned variational behavioral bottleneck compresses BFM policy-latent sequences into compact motion representations that are compatible with language and preserve long-horizon behavioral structure. Generation is performed in this compact behavioral manifold with a lightweight conditional generator, and the resulting latent encoded behaviors are decoded into policy latents that drive the pretrained frozen BFM. By decoupling semantic planning from motion execution, Text2BFM achieves efficient, robust T2M generation and strong performance on long, compositional textual descriptions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
34 of 43 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
22 more
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2016The KIT Motion-Language Datasetcited by 334
- 2016Successor Features for Transfer in Reinforcement Learningcited by 331
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2021Learning One Representation to Optimize All Rewardscited by 110
- 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
- 2022Does Zero-Shot Reinforcement Learning Exist?cited by 79
- 2021Learning Successor States and Goal-Dependent Values: A Mathematical Viewpointcited by 67
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
- 2025Zero-Shot Whole-Body Humanoid Control via Behavioral Foundation Modelscited by 51
- 2025BFM-Zero: A Promptable Behavioral Foundation Model for Humanoid Control Using Unsupervised Reinforcement Learningcited by 33
- 2026Kimodo: Scaling Controllable Human Motion Generationcited by 33
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 32
- 2024Proto Successor Measure: Representing the Behavior Space of an RL Agentcited by 17
- 2025Zero-Shot Adaptation of Behavioral Foundation Models to Unseen Dynamicscited by 8
Built on by
Not cited yet.