DiffusionPhase: Motion Diffusion in Frequency Domain
Not on the map. Why?
Abstract (arXiv)
In this study, we introduce a learning-based method for generating high-quality human motion sequences from text descriptions (e.g., ``A person walks forward"). Existing techniques struggle with motion diversity and smooth transitions in generating arbitrary-length motion sequences, due to limited text-to-motion datasets and the pose representations used that often lack expressiveness or compactness. To address these issues, we propose the first method for text-conditioned human motion generation in the frequency domain of motions. We develop a network encoder that converts the motion space into a compact yet expressive parameterized phase space with high-frequency details encoded, capturing the local periodicity of motions in time and space with high accuracy. We also introduce a conditional diffusion model for predicting periodic motion parameters based on text descriptions and a start pose, efficiently achieving smooth transitions between motion sequences associated with different text descriptions. Experiments demonstrate that our approach outperforms current methods in generating a broader variety of high-quality motions, and synthesizing long sequences with natural transitions.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 7 Dec 2023.
Builds on
25 of 33 references.
References · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
13 more
- 2016The KIT Motion-Language Datasetcited by 338
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
- 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 52
- 2022GenLoco: Generalized Locomotion Controllers for Quadrupedal Robotscited by 48
- 2022Learning Free Gait Transition for Quadruped Robots via Phase-Guided Controllercited by 29
- 2022Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Action Generationcited by 28
- 2021Dance2Music: Automatic Dance-driven Music Generationcited by 16
Built on by
Citing papers per year: 2024: 4; 2025: 7; 2026: 5.
16 papers.
Sort:
By area:
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
- 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 27
- 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
- 2025WaMo: Wavelet-Enhanced Multi-Frequency Trajectory Analysis for Fine-Grained Text-Motion Retrievalcited by 7
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generationcited by 6
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 5
- 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generationcited by 4
- 2026Language-Guided Transformer Tokenizer for Human Motion Generationcited by 2
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editingcited by 1
4 more
- 2025Diffusion Model-based Activity Completion for AI Motion Capture from Videoscited by 0
- 2025FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifoldscited by 0
- 2026T2M Mamba: Motion Periodicity-Saliency Coupling Approach for Stable Text-Driven Motion Generationcited by 0
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generationcited by 0
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning29 May 2026
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generation9 Feb 2026
- 2026Language-Guided Transformer Tokenizer for Human Motion Generation9 Feb 2026
- 2026T2M Mamba: Motion Periodicity-Saliency Coupling Approach for Stable Text-Driven Motion Generation1 Feb 2026
- 2025FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifolds10 Dec 2025
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generation16 Oct 2025
- 2025WaMo: Wavelet-Enhanced Multi-Frequency Trajectory Analysis for Fine-Grained Text-Motion Retrieval5 Aug 2025
- 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generation9 Jun 2025
- 2025Diffusion Model-based Activity Completion for AI Motion Capture from Videos27 May 2025
- 2025Absolute Coordinates Make Motion Generation Easy26 May 2025
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Prediction23 Mar 2025
4 more
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression25 Nov 2024
- 2024MotionFix: Text-Driven 3D Human Motion Editing1 Aug 2024
- 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image26 Jun 2024
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editing20 Mar 2024
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
- 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 27
- 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
- 2025WaMo: Wavelet-Enhanced Multi-Frequency Trajectory Analysis for Fine-Grained Text-Motion Retrievalcited by 7
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generationcited by 6
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 5
- 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generationcited by 4
- 2026Language-Guided Transformer Tokenizer for Human Motion Generationcited by 2
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editingcited by 1
12 most cited of 14 All 14 (JSON)
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning29 May 2026
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generation9 Feb 2026
- 2026Language-Guided Transformer Tokenizer for Human Motion Generation9 Feb 2026
- 2025FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifolds10 Dec 2025
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generation16 Oct 2025
- 2025WaMo: Wavelet-Enhanced Multi-Frequency Trajectory Analysis for Fine-Grained Text-Motion Retrieval5 Aug 2025
- 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generation9 Jun 2025
- 2025Absolute Coordinates Make Motion Generation Easy26 May 2025
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Prediction23 Mar 2025
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression25 Nov 2024
- 2024MotionFix: Text-Driven 3D Human Motion Editing1 Aug 2024
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Priority-Centric Human Motion Generation in Discrete Latent Space
- 2023Synthesizing Long-Term Human Motions with Diffusion Models via Coherent Sampling
- 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
- 2024Text-driven Human Motion Generation with Motion Masked Diffusion Model
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
- 2024FTMoMamba: Motion Generation with Frequency and Text State Space Models
- 2025PackDiT: Joint Human Motion and Text Generation via Mutual Prompting
- 2023AMD: Autoregressive Motion Diffusion