mlsanityData to 7 Oct 2026

Plan, Don't Pose: Long Composite Motion Generation with Text-Aligned BFM

arXiv 2605.29906 ↗First posted 28 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-motion (T2M) generation has broad applications in character animation, virtual avatars, and human-robot interaction. Existing methods typically generate pose trajectories or motion tokens directly from language, forcing a single model to handle semantic interpretation, long-horizon structure, and low-level physical realization. This coupling makes them costly and often unreliable for long, compositional, or semantically dense prompts. We propose Text2BFM, the first framework that aligns natural language with pretrained Behavioral Foundation Models (BFMs) for T2M generation without relying on heavy end-to-end motion generators. Text2BFM operates in the latent policy space of a frozen BFM, using it as an executable motion prior. A text-aligned variational behavioral bottleneck compresses BFM policy-latent sequences into compact motion representations that are compatible with language and preserve long-horizon behavioral structure. Generation is performed in this compact behavioral manifold with a lightweight conditional generator, and the resulting latent encoded behaviors are decoded into policy latents that drive the pretrained frozen BFM. By decoupling semantic planning from motion execution, Text2BFM achieves efficient, robust T2M generation and strong performance on long, compositional textual descriptions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

34 of 43 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  6. 2022Human Motion Diffusion Modelcited by 1,062
  7. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  9. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  10. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  11. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  12. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
22 more
  1. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  2. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  3. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  4. 2016The KIT Motion-Language Datasetcited by 334
  5. 2016Successor Features for Transfer in Reinforcement Learningcited by 331
  6. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  7. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  8. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  9. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
  10. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  11. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  12. 2021Learning One Representation to Optimize All Rewardscited by 110
  13. 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
  14. 2022Does Zero-Shot Reinforcement Learning Exist?cited by 79
  15. 2021Learning Successor States and Goal-Dependent Values: A Mathematical Viewpointcited by 67
  16. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  17. 2025Zero-Shot Whole-Body Humanoid Control via Behavioral Foundation Modelscited by 51
  18. 2025BFM-Zero: A Promptable Behavioral Foundation Model for Humanoid Control Using Unsupervised Reinforcement Learningcited by 33
  19. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 33
  20. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 32
  21. 2024Proto Successor Measure: Representing the Behavior Space of an RL Agentcited by 17
  22. 2025Zero-Shot Adaptation of Behavioral Foundation Models to Unseen Dynamicscited by 8

Built on by

Not cited yet.