mlsanityData to 14 Oct 2026

Being-M0.5: A Real-Time Controllable Vision-Language-Motion Model

arXiv 2508.07863 ↗First posted 11 Aug 2025cs.CV cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Human motion generation has emerged as a critical technology with transformative potential for real-world applications. However, existing vision-language-motion models (VLMMs) face significant limitations that hinder their practical deployment. We identify controllability as a main bottleneck, manifesting in five key aspects: inadequate response to diverse human commands, limited pose initialization capabilities, poor performance on long-term sequences, insufficient handling of unseen scenarios, and lack of fine-grained control over individual body parts. To overcome these limitations, we present Being-M0.5, the first real-time, controllable VLMM that achieves state-of-the-art performance across multiple motion generation tasks. Our approach is built upon HuMo100M, the largest and most comprehensive human motion dataset to date, comprising over 5 million self-collected motion sequences, 100 million multi-task instructional instances, and detailed part-level annotations that address a critical gap in existing datasets. We introduce a novel part-aware residual quantization technique for motion tokenization that enables precise, granular control over individual body parts during generation. Extensive experimental validation demonstrates Being-M0.5's superior performance across diverse motion benchmarks, while comprehensive efficiency analysis confirms its real-time capabilities. Our contributions include design insights and detailed computational analysis to guide future development of practical motion generators. We believe that HuMo100M and Being-M0.5 represent significant advances that will accelerate the adoption of motion generation technologies in real-world applications. The project page is available at https://beingbeyond.github.io/Being-M0.5.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 53 of its 62 references that are in the map. First posted on arXiv 11 Aug 2025.

Builds on

53 of 62 references.

References · 53

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  7. 2017Neural Discrete Representation Learningcited by 4,712
  8. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  10. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  11. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  12. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
38 more
  1. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  2. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  3. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  4. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  6. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  7. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  8. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  9. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  10. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  11. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  12. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  13. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  14. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  15. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  16. 2016The KIT Motion-Language Datasetcited by 338
  17. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
  18. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  19. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  20. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  21. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
  22. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
  23. 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
  24. 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
  25. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
  26. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 90
  27. 2018A Neural Temporal Model for Human Motion Predictioncited by 87
  28. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  29. 2023AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyondcited by 63
  30. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
  31. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 55
  32. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
  33. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
  34. 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
  35. 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 38
  36. 2024MotionChain: Conversational Motion Controllers via Multimodal Promptscited by 30
  37. 2024Scaling Large Motion Models with Million-Level Human Motionscited by 22
  38. 2025Fg-T2M++: LLMs-Augmented Fine-Grained Text Driven Human Motion Generationcited by 21

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 7.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Spatial-Temporal Multi-Scale Quantization for Flexible Motion Generation
  2. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editing
  3. 2025HMVLM: Human Motion-Vision-Lanuage Model via MoE LoRA
  4. 2025UniHM: Universal Human Motion Generation with Object Interactions in Indoor Scenes
  5. 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
  6. 2026FrankenMotion: Part-level Human Motion Generation and Composition
  7. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videos
  8. 2023A Unified Framework for Multimodal, Multi-Part Human Motion Synthesis