mlsanityData to 14 Oct 2026

DiffusionPhase: Motion Diffusion in Frequency Domain

arXiv 2312.04036 ↗First posted 7 Dec 2023cs.CV cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

In this study, we introduce a learning-based method for generating high-quality human motion sequences from text descriptions (e.g., ``A person walks forward"). Existing techniques struggle with motion diversity and smooth transitions in generating arbitrary-length motion sequences, due to limited text-to-motion datasets and the pose representations used that often lack expressiveness or compactness. To address these issues, we propose the first method for text-conditioned human motion generation in the frequency domain of motions. We develop a network encoder that converts the motion space into a compact yet expressive parameterized phase space with high-frequency details encoded, capturing the local periodicity of motions in time and space with high accuracy. We also introduce a conditional diffusion model for predicting periodic motion parameters based on text descriptions and a start pose, efficiently achieving smooth transitions between motion sequences associated with different text descriptions. Experiments demonstrate that our approach outperforms current methods in generating a broader variety of high-quality motions, and synthesizing long sequences with natural transitions.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 7 Dec 2023.

Builds on

25 of 33 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2022Human Motion Diffusion Modelcited by 1,080
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  6. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  7. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  8. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  9. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  10. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  11. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  12. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
13 more
  1. 2016The KIT Motion-Language Datasetcited by 338
  2. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  3. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  4. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  5. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  6. 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
  7. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  8. 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
  9. 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 52
  10. 2022GenLoco: Generalized Locomotion Controllers for Quadrupedal Robotscited by 48
  11. 2022Learning Free Gait Transition for Quadruped Robots via Phase-Guided Controllercited by 29
  12. 2022Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Action Generationcited by 28
  13. 2021Dance2Music: Automatic Dance-driven Music Generationcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 7; 2026: 5.

16 papers.

Sort:

By area:

  1. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  2. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
  3. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
  4. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  5. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 27
  6. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  7. 2025WaMo: Wavelet-Enhanced Multi-Frequency Trajectory Analysis for Fine-Grained Text-Motion Retrievalcited by 7
  8. 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generationcited by 6
  9. 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 5
  10. 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generationcited by 4
  11. 2026Language-Guided Transformer Tokenizer for Human Motion Generationcited by 2
  12. 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editingcited by 1
4 more
  1. 2025Diffusion Model-based Activity Completion for AI Motion Capture from Videoscited by 0
  2. 2025FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifoldscited by 0
  3. 2026T2M Mamba: Motion Periodicity-Saliency Coupling Approach for Stable Text-Driven Motion Generationcited by 0
  4. 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Priority-Centric Human Motion Generation in Discrete Latent Space
  2. 2023Synthesizing Long-Term Human Motions with Diffusion Models via Coherent Sampling
  3. 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
  4. 2024Text-driven Human Motion Generation with Motion Masked Diffusion Model
  5. 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
  6. 2024FTMoMamba: Motion Generation with Frequency and Text State Space Models
  7. 2025PackDiT: Joint Human Motion and Text Generation via Mutual Prompting
  8. 2023AMD: Autoregressive Motion Diffusion