mlsanityData to 14 Oct 2026

MOGO: Residual Quantized Hierarchical Causal Transformer for High-Quality and Real-Time 3D Human Motion Generation

arXiv 2506.05952 ↗First posted 6 Jun 2025cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Recent advances in transformer-based text-to-motion generation have led to impressive progress in synthesizing high-quality human motion. Nevertheless, jointly achieving high fidelity, streaming capability, real-time responsiveness, and scalability remains a fundamental challenge. In this paper, we propose MOGO (Motion Generation with One-pass), a novel autoregressive framework tailored for efficient and real-time 3D motion generation. MOGO comprises two key components: (1) MoSA-VQ, a motion scale-adaptive residual vector quantization module that hierarchically discretizes motion sequences with learnable scaling to produce compact yet expressive representations; and (2) RQHC-Transformer, a residual quantized hierarchical causal transformer that generates multi-layer motion tokens in a single forward pass, significantly reducing inference latency. To enhance semantic fidelity, we further introduce a text condition alignment mechanism that improves motion decoding under textual control. Extensive experiments on benchmark datasets including HumanML3D, KIT-ML, and CMP demonstrate that MOGO achieves competitive or superior generation quality compared to state-of-the-art transformer-based methods, while offering substantial improvements in real-time performance, streaming generation, and generalization under zero-shot settings.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 6 Jun 2025.

Builds on

35 of 44 references.

References · 35

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  7. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  8. 2022Human Motion Diffusion Modelcited by 1,080
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  10. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  11. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  12. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
23 more
  1. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  2. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  3. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
  4. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  5. 2016The KIT Motion-Language Datasetcited by 338
  6. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
  7. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  8. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  9. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  10. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
  11. 2023MMM: Generative Masked Motion Modelcited by 131
  12. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  13. 2019Hierarchical Transformers for Long Document Classificationcited by 104
  14. 2021Hierarchical Transformers Are More Efficient Language Modelscited by 102
  15. 2023Human Motion Generation: A Surveycited by 96
  16. 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Modelcited by 79
  17. 2023Priority-Centric Human Motion Generation in Discrete Latent Spacecited by 67
  18. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
  19. 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 52
  20. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
  21. 2025Motion Anything: Any to Motion Generationcited by 42
  22. 2021Action2video: Generating Videos of Human 3D Actionscited by 15
  23. 2023Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentationcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Mogo: RQ Hierarchical Causal Transformer for High-Quality 3D Human Motion Generation
  2. 2025MoSa: Motion Generation with Scalable Autoregressive Modeling
  3. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression
  4. 2023T2M-HiFiGPT: Generating High Quality Human Motion from Textual Descriptions with Residual Discrete Representations
  5. 2026ScaleMoGen: Autoregressive Next-Scale Prediction for Human Motion Generation
  6. 2026Causal Motion Diffusion Models for Autoregressive Motion Generation
  7. 2026DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding
  8. 2026Image Diffusion Models Are Good 3D Human Motion Generators