DC-Motion: Decoupling Structure and Details via Discrete-Continuous Tokens for Human Motion Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Text-to-motion generation requires modeling both global action structure and fine-grained motion dynamics from natural language. Existing approaches typically rely on either continuous diffusion models or vector-quantized discrete representations. Diffusion models generate smooth motions but lack explicit compositional structure for temporal planning, while discrete token-based methods improve controllability but compress motion into finite codebooks, losing fine-grained dynamics. We argue that this limitation stems from a representation mismatch: action semantics such as intent, phase transitions, and temporal layout are inherently discrete and compositional, whereas joint trajectories and motion dynamics are continuous and locally correlated. To address this, we propose DC-Motion, a discrete-continuous factorized framework for human motion generation. DC-Motion decomposes motion into discrete structural tokens capturing global action layout and continuous residual latents modeling fine-grained dynamics. A text-conditioned structure generator predicts discrete tokens via iterative masked modeling, and a diffusion-based residual generator produces continuous motion conditioned on the structure. Experiments on HumanML3D and KIT-ML demonstrate that DC-Motion achieves strong performance in both FID and R-Precision, outperforming representative diffusion-based and discrete-token baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 39 of its 46 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
39 of 46 references.
Closest ancestors · 8
Same direction, newest first
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generation26 Feb
- 2025Strong and Controllable 3D Motion Generation30 Jan
- 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction16 Aug
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
- 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
- 2022Human Motion Diffusion Model29 Sep
- 2022FLAME: Free-form Language-based Motion Synthesis & Editing1 Sep
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug
Other references · 31
- 2017Neural Discrete Representation Learningcited by 4,650
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2016The KIT Motion-Language Datasetcited by 334
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
- 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 257
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
19 more
- 2021FaceFormer: Speech-Driven 3D Facial Animation with Transformerscited by 208
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
- 2023MMM: Generative Masked Motion Modelcited by 129
- 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
- 2023Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometrycited by 35
- 2024SemTalk: Holistic Co-speech Motion Generation with Frame-level Semantic Emphasiscited by 32
- 2022Joint-bone Fusion Graph Convolutional Network for Semi-supervised Skeleton Action Recognitioncited by 24
- 2024Light-T2M: A Lightweight and Fast Model for Text-to-motion Generationcited by 21
- 2024Generative Zoocited by 12
- 2025Motion-example-controlled Co-speech Gesture Generation Leveraging Large Language Modelscited by 10
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 10
- 2024Diffusion Implicit Policy for Unpaired Scene-aware Motion Synthesiscited by 6
- 2026Temporal Consistency-Aware Text-to-Motion Generationcited by 5
- 2025SegMo: Segment-aligned Text to 3D Human Motion Generationcited by 3
- 2024Mogo: RQ Hierarchical Causal Transformer for High-Quality 3D Human Motion Generationcited by 2
- 2025Jointly Understand Your Command and Intention:Reciprocal Co-Evolution between Scene-Aware 3D Human Motion Synthesis and Analysiscited by 2
- 2026Coordinating Multiple Conditions for Trajectory-Controlled Human Motion Generationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Priority-Centric Human Motion Generation in Discrete Latent Space
- 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphs
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression
- 2026Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizer
- 2026Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions
- 2024DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding
- 2024Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation