mlsanityData to 14 Oct 2026

DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding

arXiv 2411.19527 ↗First posted 29 Nov 2024cs.CV cs.AI cs.LGcited by 19

On the map: Diffusion models → Video generation

Abstract (arXiv)

Human motion is inherently continuous and dynamic, posing significant challenges for generative models. While discrete generation methods are widely used, they suffer from limited expressiveness and frame-wise noise artifacts. In contrast, continuous approaches produce smoother, more natural motion but often struggle to adhere to conditioning signals due to high-dimensional complexity and limited training data. To resolve this 'discord' between discrete and continuous representations we introduce DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding, a novel method that leverages rectified flow to decode discrete motion tokens in the continuous, raw motion space. Our core idea is to frame token decoding as a conditional generation task, ensuring that DisCoRD captures fine-grained dynamics and achieves smoother, more natural motions. Compatible with any discrete-based framework, our method enhances naturalness without compromising faithfulness to the conditioning signals on diverse settings. Extensive evaluations demonstrate that DisCoRD achieves state-of-the-art performance, with FID of 0.032 on HumanML3D and 0.169 on KIT-ML. These results establish DisCoRD as a robust solution for bridging the divide between discrete efficiency and continuous realism. Project website: https://whwjdqls.github.io/discord-motion/

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 58 of its 77 references that are in the map. First posted on arXiv 29 Nov 2024.

Builds on

58 of 77 references.

Closest ancestors · 13

Same direction, newest first

  1. 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models19 Jul
  2. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
  3. 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Model12 Sep
  4. 2023MCM: Multi-condition Motion Synthesis Framework for Multi-scenario6 Sep
  5. 2023DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion4 Sep
  6. 2023Priority-Centric Human Motion Generation in Discrete Latent Space28 Aug
  7. 2023Generative Proxemics: A Prior for 3D Social Interaction from Images15 Jun
  8. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  9. 2023Human Motion Diffusion as a Generative Prior2 Mar
  10. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  11. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
  12. 2022Human Motion Diffusion Model29 Sep
1 more
  1. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2017Neural Discrete Representation Learningcited by 4,712
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  8. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  9. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  10. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  11. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  12. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
33 more
  1. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  2. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  3. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  4. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  5. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  6. 2016The KIT Motion-Language Datasetcited by 338
  7. 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
  8. 2022EDGE: Editable Dance Generation From Musiccited by 287
  9. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
  10. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
  11. 2022Generating Holistic 3D Human Motion from Speechcited by 180
  12. 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 178
  13. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  14. 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
  15. 2023MMM: Generative Masked Motion Modelcited by 131
  16. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  17. 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
  18. 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 105
  19. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  20. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  21. 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
  22. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
  23. 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
  24. 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
  25. 2022Being Comes from Not-being: Open-vocabulary Text-to-Motion Generation with Wordless Trainingcited by 45
  26. 2024Towards Variable and Coordinated Holistic Co-Speech Motion Generationcited by 29
  27. 2020A review of 3D human pose estimation algorithms for markerless motion capturecited by 24
  28. 2024POPDG: Popular 3D Dance Generation with PopDanceSetcited by 24
  29. 2023What is the Best Automated Metric for Text to Motion Generation?cited by 19
  30. 2024UniMuMo: Unified Text, Music and Motion Generationcited by 19
  31. 2024BAD: Bidirectional Auto-regressive Diffusion for Text-to-Motion Generationcited by 13
  32. 2022Evaluating the Quality of a Synthesized Motion with the Fr'echet Motion Distancecited by 8
  33. 2024Sample what you cant compresscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 11.

19 papers.

Sort:

By area:

  1. 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
  2. 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
  3. 2026FrankenMotion: Part-level Human Motion Generation and Compositioncited by 10
  4. 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 6
  5. 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planningcited by 5
  6. 2025ZOO-Prune: Training-Free Token Pruning via Zeroth-Order Gradient Estimation in Vision-Language Modelscited by 4
  7. 2025Human Motion Unlearningcited by 3
  8. 2025SegMo: Segment-aligned Text to 3D Human Motion Generationcited by 3
  9. 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decompositioncited by 3
  10. 2025RA-Touch: Retrieval-Augmented Touch Understanding with Enriched Visual Datacited by 2
  11. 2025MoLingo: Motion-Language Alignment for Text-to-Human Motion Generationcited by 2
  12. 2026Language-Guided Transformer Tokenizer for Human Motion Generationcited by 2
7 more
  1. 2026MotionVLA: Vision-Language-Action Model for Humanoid Motioncited by 2
  2. 2026ParTY: Part-Guidance for Expressive Text-to-Motion Synthesiscited by 1
  3. 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generationcited by 1
  4. 2025SceneAdapt: Scene-aware Adaptation of Human Motion Diffusioncited by 0
  5. 2026MAD-HOI: Masked Autoregressive Diffusion for Generating Articulated Hand Object Interactions from Textcited by 0
  6. 2026Rethinking Fixed Temporal Grids: Frequency-Disentangled Motion Generationcited by 0
  7. 2026Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Modelcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026DC-Motion: Decoupling Structure and Details via Discrete-Continuous Tokens for Human Motion Generation
  2. 2026DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding
  3. 2026From Diffusion to Flow: Efficient Motion Generation in MotionGPT3
  4. 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space
  5. 2026Spatiotemporally Decoupled Autoregressive Diffusion Model for Human Motion Generation
  6. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space
  7. 2026MotionMaestro: Masked Tokenization for Unified Motion Generation
  8. 2026FlowCoMotion: Text-to-Motion Generation via Token-Latent Flow Modeling