DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding
On the map: Diffusion models → Video generation
Abstract (arXiv)
Human motion is inherently continuous and dynamic, posing significant challenges for generative models. While discrete generation methods are widely used, they suffer from limited expressiveness and frame-wise noise artifacts. In contrast, continuous approaches produce smoother, more natural motion but often struggle to adhere to conditioning signals due to high-dimensional complexity and limited training data. To resolve this 'discord' between discrete and continuous representations we introduce DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding, a novel method that leverages rectified flow to decode discrete motion tokens in the continuous, raw motion space. Our core idea is to frame token decoding as a conditional generation task, ensuring that DisCoRD captures fine-grained dynamics and achieves smoother, more natural motions. Compatible with any discrete-based framework, our method enhances naturalness without compromising faithfulness to the conditioning signals on diverse settings. Extensive evaluations demonstrate that DisCoRD achieves state-of-the-art performance, with FID of 0.032 on HumanML3D and 0.169 on KIT-ML. These results establish DisCoRD as a robust solution for bridging the divide between discrete efficiency and continuous realism. Project website: https://whwjdqls.github.io/discord-motion/
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 58 of its 77 references that are in the map. First posted on arXiv 29 Nov 2024.
Builds on
58 of 77 references.
Closest ancestors · 13
Same direction, newest first
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models19 Jul
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
- 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Model12 Sep
- 2023MCM: Multi-condition Motion Synthesis Framework for Multi-scenario6 Sep
- 2023DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion4 Sep
- 2023Priority-Centric Human Motion Generation in Discrete Latent Space28 Aug
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Images15 Jun
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
- 2023Human Motion Diffusion as a Generative Prior2 Mar
- 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
- 2022Human Motion Diffusion Model29 Sep
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
33 more
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
- 2016The KIT Motion-Language Datasetcited by 338
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
- 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 178
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2023MMM: Generative Masked Motion Modelcited by 131
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
- 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
- 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 105
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
- 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
- 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
- 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
- 2022Being Comes from Not-being: Open-vocabulary Text-to-Motion Generation with Wordless Trainingcited by 45
- 2024Towards Variable and Coordinated Holistic Co-Speech Motion Generationcited by 29
- 2020A review of 3D human pose estimation algorithms for markerless motion capturecited by 24
- 2024POPDG: Popular 3D Dance Generation with PopDanceSetcited by 24
- 2023What is the Best Automated Metric for Text to Motion Generation?cited by 19
- 2024UniMuMo: Unified Text, Music and Motion Generationcited by 19
- 2024BAD: Bidirectional Auto-regressive Diffusion for Text-to-Motion Generationcited by 13
- 2022Evaluating the Quality of a Synthesized Motion with the Fr'echet Motion Distancecited by 8
- 2024Sample what you cant compresscited by 5
Built on by
Citing papers per year: 2025: 8; 2026: 11.
19 papers.
Sort:
By area:
- 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
- 2026FrankenMotion: Part-level Human Motion Generation and Compositioncited by 10
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 6
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planningcited by 5
- 2025ZOO-Prune: Training-Free Token Pruning via Zeroth-Order Gradient Estimation in Vision-Language Modelscited by 4
- 2025Human Motion Unlearningcited by 3
- 2025SegMo: Segment-aligned Text to 3D Human Motion Generationcited by 3
- 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decompositioncited by 3
- 2025RA-Touch: Retrieval-Augmented Touch Understanding with Enriched Visual Datacited by 2
- 2025MoLingo: Motion-Language Alignment for Text-to-Human Motion Generationcited by 2
- 2026Language-Guided Transformer Tokenizer for Human Motion Generationcited by 2
7 more
- 2026MotionVLA: Vision-Language-Action Model for Humanoid Motioncited by 2
- 2026ParTY: Part-Guidance for Expressive Text-to-Motion Synthesiscited by 1
- 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generationcited by 1
- 2025SceneAdapt: Scene-aware Adaptation of Human Motion Diffusioncited by 0
- 2026MAD-HOI: Masked Autoregressive Diffusion for Generating Articulated Hand Object Interactions from Textcited by 0
- 2026Rethinking Fixed Temporal Grids: Frequency-Disentangled Motion Generationcited by 0
- 2026Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Modelcited by 0
- 2026Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Model2 Oct 2026
- 2026Rethinking Fixed Temporal Grids: Frequency-Disentangled Motion Generation2 Oct 2026
- 2026MAD-HOI: Masked Autoregressive Diffusion for Generating Articulated Hand Object Interactions from Text10 Aug 2026
- 2026MotionVLA: Vision-Language-Action Model for Humanoid Motion13 Jun 2026
- 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generation9 Apr 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026ParTY: Part-Guidance for Expressive Text-to-Motion Synthesis10 Mar 2026
- 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition9 Mar 2026
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens12 Feb 2026
- 2026Language-Guided Transformer Tokenizer for Human Motion Generation9 Feb 2026
- 2026FrankenMotion: Part-level Human Motion Generation and Composition15 Jan 2026
- 2025SegMo: Segment-aligned Text to 3D Human Motion Generation24 Dec 2025
7 more
- 2025MoLingo: Motion-Language Alignment for Text-to-Human Motion Generation15 Dec 2025
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generation11 Dec 2025
- 2025SceneAdapt: Scene-aware Adaptation of Human Motion Diffusion14 Oct 2025
- 2025ZOO-Prune: Training-Free Token Pruning via Zeroth-Order Gradient Estimation in Vision-Language Models29 Sep 2025
- 2025MotionGPT3: Human Motion as a Second Modality30 Jun 2025
- 2025RA-Touch: Retrieval-Augmented Touch Understanding with Enriched Visual Data20 May 2025
- 2025Human Motion Unlearning24 Mar 2025
- 2025Human Motion Unlearningcited by 3
- 2025Human Motion Unlearning24 Mar 2025
- 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
- 2026FrankenMotion: Part-level Human Motion Generation and Compositioncited by 10
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 6
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planningcited by 5
- 2025SegMo: Segment-aligned Text to 3D Human Motion Generationcited by 3
- 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decompositioncited by 3
- 2025RA-Touch: Retrieval-Augmented Touch Understanding with Enriched Visual Datacited by 2
- 2025MoLingo: Motion-Language Alignment for Text-to-Human Motion Generationcited by 2
- 2026Language-Guided Transformer Tokenizer for Human Motion Generationcited by 2
- 2026MotionVLA: Vision-Language-Action Model for Humanoid Motioncited by 2
- 2026ParTY: Part-Guidance for Expressive Text-to-Motion Synthesiscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Rethinking Fixed Temporal Grids: Frequency-Disentangled Motion Generation2 Oct 2026
- 2026MotionVLA: Vision-Language-Action Model for Humanoid Motion13 Jun 2026
- 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generation9 Apr 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026ParTY: Part-Guidance for Expressive Text-to-Motion Synthesis10 Mar 2026
- 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition9 Mar 2026
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens12 Feb 2026
- 2026Language-Guided Transformer Tokenizer for Human Motion Generation9 Feb 2026
- 2026FrankenMotion: Part-level Human Motion Generation and Composition15 Jan 2026
- 2025SegMo: Segment-aligned Text to 3D Human Motion Generation24 Dec 2025
- 2025MoLingo: Motion-Language Alignment for Text-to-Human Motion Generation15 Dec 2025
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generation11 Dec 2025
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026DC-Motion: Decoupling Structure and Details via Discrete-Continuous Tokens for Human Motion Generation
- 2026DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding
- 2026From Diffusion to Flow: Efficient Motion Generation in MotionGPT3
- 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space
- 2026Spatiotemporally Decoupled Autoregressive Diffusion Model for Human Motion Generation
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space
- 2026MotionMaestro: Masked Tokenization for Unified Motion Generation
- 2026FlowCoMotion: Text-to-Motion Generation via Token-Latent Flow Modeling