mlsanityData to 14 Oct 2026

Making Pose Representations More Expressive and Disentangled via Residual Vector Quantization

arXiv 2508.14561 ↗First posted 20 Aug 2025cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent progress in text-to-motion has advanced both 3D human motion generation and text-based motion control. Controllable motion generation (CoMo), which enables intuitive control, typically relies on pose code representations, but discrete pose codes alone cannot capture fine-grained motion details, limiting expressiveness. To overcome this, we propose a method that augments pose code-based latent representations with continuous motion features using residual vector quantization (RVQ). This design preserves the interpretability and manipulability of pose codes while effectively capturing subtle motion characteristics such as high-frequency details. Experiments on the HumanML3D dataset show that our model reduces Frechet inception distance (FID) from 0.041 to 0.015 and improves Top-1 R-Precision from 0.508 to 0.510. Qualitative analysis of pairwise direction similarity between pose codes further confirms the model's controllability for motion editing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 19 references that are in the map. First posted on arXiv 20 Aug 2025.

Builds on

16 of 19 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  4. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  5. 2022High Fidelity Neural Audio Compressioncited by 687
  6. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  7. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  8. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  9. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  10. 2023MMM: Generative Masked Motion Modelcited by 131
  11. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
  12. 2023MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representationscited by 60
4 more
  1. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 55
  2. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 41
  3. 2023T2M-HiFiGPT: Generating High Quality Human Motion from Textual Descriptions with Residual Discrete Representationscited by 10
  4. 2025CODA: Repurposing Continuous VAEs for Discrete Tokenizationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Pose-Guided Residual Refinement for Interpretable Text-to-Motion Generation and Editing
  2. 2025Spatial-Temporal Multi-Scale Quantization for Flexible Motion Generation
  3. 2025Being-M0.5: A Real-Time Controllable Vision-Language-Motion Model
  4. 2025MOGO: Residual Quantized Hierarchical Causal Transformer for High-Quality and Real-Time 3D Human Motion Generation
  5. 2025MoSa: Motion Generation with Scalable Autoregressive Modeling
  6. 2023QPoser: Quantized Explicit Pose Prior Modeling for Controllable Pose Generation
  7. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression
  8. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding