mlsanityData to 14 Oct 2026

MotionWavelet: Human Motion Prediction via Wavelet Manifold Learning

arXiv 2411.16964 ↗First posted 25 Nov 2024cs.CV cs.GR cs.ROcited by 8

On the map: Diffusion models → Video generation

Abstract (arXiv)

Modeling temporal characteristics and the non-stationary dynamics of body movement plays a significant role in predicting human future motions. However, it is challenging to capture these features due to the subtle transitions involved in the complex human motions. This paper introduces MotionWavelet, a human motion prediction framework that utilizes Wavelet Transformation and studies human motion patterns in the spatial-frequency domain. In MotionWavelet, a Wavelet Diffusion Model (WDM) learns a Wavelet Manifold by applying Wavelet Transformation on the motion data therefore encoding the intricate spatial and temporal motion patterns. Once the Wavelet Manifold is built, WDM trains a diffusion model to generate human motions from Wavelet latent vectors. In addition to the WDM, MotionWavelet also presents a Wavelet Space Shaping Guidance mechanism to refine the denoising process to improve conformity with the manifold structure. WDM also develops Temporal Attention-Based Guidance to enhance prediction accuracy. Extensive experiments validate the effectiveness of MotionWavelet, demonstrating improved prediction accuracy and enhanced generalization across various benchmarks. Our code and models will be released upon acceptance.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 59 of its 84 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

59 of 84 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editing24 Oct
  2. 2024Learning Semantic Latent Directions for Accurate and Controllable Human Motion Prediction16 Jul
  3. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
  4. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation4 Dec
  5. 2023Human Motion Diffusion as a Generative Prior2 Mar
  6. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  7. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
  8. 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction25 Nov
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  10. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  11. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  12. 2013Generating Sequences With Recurrent Neural Networkscited by 554
38 more
  1. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  2. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  3. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
  4. 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 307
  5. 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 254
  6. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
  7. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  8. 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
  9. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 185
  10. 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 155
  11. 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 154
  12. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  13. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
  14. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 94
  15. 2019Diverse Trajectory Forecasting with Determinantal Point Processescited by 80
  16. 2017DeLiGAN : Generative Adversarial Networks for Diverse and Limited Datacited by 77
  17. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
  18. 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
  19. 2018Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objectivecited by 56
  20. 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 55
  21. 2022TORE: Token Reduction for Efficient Human Mesh Recovery with Transformercited by 41
  22. 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
  23. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  24. 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
  25. 2022Motron: Multimodal Probabilistic Human Motion Forecastingcited by 30
  26. 2022Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Predictioncited by 28
  27. 2023Motion In-Betweening with Phase Manifoldscited by 25
  28. 2022Learn to Predict How Humans Manipulate Large-sized Objects from Interactive Motionscited by 21
  29. 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusioncited by 21
  30. 2024Multi-Transmotion: Pre-trained Model for Human Motion Predictioncited by 21
  31. 2021Behavior-Driven Synthesis of Human Dynamicscited by 14
  32. 2024WalkTheDog: Cross-Morphology Motion Alignment via Phase Manifoldscited by 14
  33. 2023MuscleVAE: Model-Based Controllers of Muscle-Actuated Characterscited by 13
  34. 2024AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scalecited by 11
  35. 2023DROP: Dynamics Responses from Human Motion Prior and Projective Dynamicscited by 10
  36. 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
  37. 2023Bidirectional GaitNet: A Bidirectional Prediction Model of Human Gait and Anatomical Conditionscited by 3
  38. 2024Muscles in Time: Learning to Understand Human Motion by Simulating Muscle Activationscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 2.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025HumanCM: One Step Human Motion Prediction
  2. 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Prediction
  3. 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction
  4. 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
  5. 2022Human Motion Diffusion Model
  6. 2024Bayesian-Optimized One-Step Diffusion Model with Knowledge Distillation for Real-Time 3D Human Motion Prediction
  7. 2023DiffusionPhase: Motion Diffusion in Frequency Domain
  8. 2025Back to Basics: Motion Representation Matters for Human Motion Generation Using Diffusion Model