Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling
Not on the map. Why?
Abstract (arXiv)
Human motion generation models are fundamentally constrained by the limited diversity of motion capture datasets, which predominantly contain common, repetitive actions and fail to cover the long tail of complex human movements, resulting in a restricted motion vocabulary in learned latent representations and poor generalization to rare, compositional, and highly dynamic motions. In this work, we propose a framework for expanding the motion representation space by leveraging large-scale synthetic human motion, introducing a data generation pipeline that produces diverse, physically plausible motion sequences beyond the distribution of existing datasets and integrating it with a redesigned VQ-VAE tokenizer that adapts to this expanded motion space. Unlike conventional tokenizers trained on narrow data distributions, our approach jointly scales both the training distribution and the discrete codebook, enabling the model to capture a significantly richer set of motion primitives. We demonstrate that training with synthetic motion substantially improves the coverage and compositionality of the learned motion vocabulary, leading to consistent gains across motion generation tasks such as text-to-motion and motion continuation, while remaining fully compatible with existing frameworks including MotionGPT. Our results suggest that the primary bottleneck lies in the limited support of the learned motion representation, rather than model architecture alone. Scaling synthetic motion in tandem with representation learning offers a principled path toward more expressive, controllable, and generalizable human motion synthesis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
31 of 40 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2017Neural Discrete Representation Learningcited by 4,712
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
19 more
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2016The KIT Motion-Language Datasetcited by 338
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 89
- 2020Cascaded deep monocular 3D human pose estimation with evolutionary training datacited by 80
- 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
- 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 47
- 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
- 2024Self-Correcting Self-Consuming Loops for Generative Model Trainingcited by 37
- 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
- 2024MotionChain: Conversational Motion Controllers via Multimodal Promptscited by 30
- 2022MotionAug: Augmentation with Physical Correction for Human Motion Predictioncited by 13
- 2024MotionRL: Align Text-to-Motion Generation to Human Preferences with Multi-Reward Reinforcement Learningcited by 10
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Bindingcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.