MOGO: Residual Quantized Hierarchical Causal Transformer for High-Quality and Real-Time 3D Human Motion Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in transformer-based text-to-motion generation have led to impressive progress in synthesizing high-quality human motion. Nevertheless, jointly achieving high fidelity, streaming capability, real-time responsiveness, and scalability remains a fundamental challenge. In this paper, we propose MOGO (Motion Generation with One-pass), a novel autoregressive framework tailored for efficient and real-time 3D motion generation. MOGO comprises two key components: (1) MoSA-VQ, a motion scale-adaptive residual vector quantization module that hierarchically discretizes motion sequences with learnable scaling to produce compact yet expressive representations; and (2) RQHC-Transformer, a residual quantized hierarchical causal transformer that generates multi-layer motion tokens in a single forward pass, significantly reducing inference latency. To enhance semantic fidelity, we further introduce a text condition alignment mechanism that improves motion decoding under textual control. Extensive experiments on benchmark datasets including HumanML3D, KIT-ML, and CMP demonstrate that MOGO achieves competitive or superior generation quality compared to state-of-the-art transformer-based methods, while offering substantial improvements in real-time performance, streaming generation, and generalization under zero-shot settings.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 6 Jun 2025.
Builds on
35 of 44 references.
References · 35
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Neural Discrete Representation Learningcited by 4,712
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
23 more
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
- 2016The KIT Motion-Language Datasetcited by 338
- 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
- 2023MMM: Generative Masked Motion Modelcited by 131
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
- 2019Hierarchical Transformers for Long Document Classificationcited by 104
- 2021Hierarchical Transformers Are More Efficient Language Modelscited by 102
- 2023Human Motion Generation: A Surveycited by 96
- 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Modelcited by 79
- 2023Priority-Centric Human Motion Generation in Discrete Latent Spacecited by 67
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
- 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 52
- 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
- 2025Motion Anything: Any to Motion Generationcited by 42
- 2021Action2video: Generating Videos of Human 3D Actionscited by 15
- 2023Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentationcited by 8
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Mogo: RQ Hierarchical Causal Transformer for High-Quality 3D Human Motion Generation
- 2025MoSa: Motion Generation with Scalable Autoregressive Modeling
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression
- 2023T2M-HiFiGPT: Generating High Quality Human Motion from Textual Descriptions with Residual Discrete Representations
- 2026ScaleMoGen: Autoregressive Next-Scale Prediction for Human Motion Generation
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generation
- 2026DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding
- 2026Image Diffusion Models Are Good 3D Human Motion Generators