Being-M0.5: A Real-Time Controllable Vision-Language-Motion Model
Not on the map. Why?
Abstract (arXiv)
Human motion generation has emerged as a critical technology with transformative potential for real-world applications. However, existing vision-language-motion models (VLMMs) face significant limitations that hinder their practical deployment. We identify controllability as a main bottleneck, manifesting in five key aspects: inadequate response to diverse human commands, limited pose initialization capabilities, poor performance on long-term sequences, insufficient handling of unseen scenarios, and lack of fine-grained control over individual body parts. To overcome these limitations, we present Being-M0.5, the first real-time, controllable VLMM that achieves state-of-the-art performance across multiple motion generation tasks. Our approach is built upon HuMo100M, the largest and most comprehensive human motion dataset to date, comprising over 5 million self-collected motion sequences, 100 million multi-task instructional instances, and detailed part-level annotations that address a critical gap in existing datasets. We introduce a novel part-aware residual quantization technique for motion tokenization that enables precise, granular control over individual body parts during generation. Extensive experimental validation demonstrates Being-M0.5's superior performance across diverse motion benchmarks, while comprehensive efficiency analysis confirms its real-time capabilities. Our contributions include design insights and detailed computational analysis to guide future development of practical motion generators. We believe that HuMo100M and Being-M0.5 represent significant advances that will accelerate the adoption of motion generation technologies in real-world applications. The project page is available at https://beingbeyond.github.io/Being-M0.5.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 53 of its 62 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
53 of 62 references.
References · 53
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
38 more
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2016The KIT Motion-Language Datasetcited by 338
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
- 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 90
- 2018A Neural Temporal Model for Human Motion Predictioncited by 87
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2023AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyondcited by 63
- 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
- 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 55
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
- 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
- 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
- 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 38
- 2024MotionChain: Conversational Motion Controllers via Multimodal Promptscited by 30
- 2024Scaling Large Motion Models with Million-Level Human Motionscited by 22
- 2025Fg-T2M++: LLMs-Augmented Fine-Grained Text Driven Human Motion Generationcited by 21
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 7.
10 papers.
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 6
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videoscited by 6
- 2026OpenT2M: No-frill Motion Generation with Open-source,Large-scale, High-quality Datacited by 2
- 2026Iterative Closed-Loop Motion Synthesis for Scaling the Capabilities of Humanoid Controlcited by 1
- 2026MRBench: A Comprehensive Benchmark for Human Motion-Text Retrievalcited by 1
- 2025Robust Motion Generation using Part-level Reliable Data from Videoscited by 0
- 2026Human-Centric Intelligence in the Era of Foundation Models: A Surveycited by 0
- 2026Open-UniMo: Towards Unified Motion-Language Understanding and Generation in the Open Worldcited by 0
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robotscited by 0
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots8 Oct 2026
- 2026Open-UniMo: Towards Unified Motion-Language Understanding and Generation in the Open World13 Sep 2026
- 2026Human-Centric Intelligence in the Era of Foundation Models: A Survey18 Aug 2026
- 2026MRBench: A Comprehensive Benchmark for Human Motion-Text Retrieval8 Aug 2026
- 2026OpenT2M: No-frill Motion Generation with Open-source,Large-scale, High-quality Data19 Mar 2026
- 2026Iterative Closed-Loop Motion Synthesis for Scaling the Capabilities of Humanoid Control25 Feb 2026
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videos15 Jan 2026
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation29 Dec 2025
- 2025Robust Motion Generation using Part-level Reliable Data from Videos14 Dec 2025
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generation11 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Spatial-Temporal Multi-Scale Quantization for Flexible Motion Generation
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editing
- 2025HMVLM: Human Motion-Vision-Lanuage Model via MoE LoRA
- 2025UniHM: Universal Human Motion Generation with Object Interactions in Indoor Scenes
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
- 2026FrankenMotion: Part-level Human Motion Generation and Composition
- 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videos
- 2023A Unified Framework for Multimodal, Multi-Part Human Motion Synthesis