mlsanityData to 14 Oct 2026

NeMF: Neural Motion Fields for Kinematic Animation

arXiv 2206.03287 ↗First posted 4 Jun 2022cs.CV cs.GRcited by 68

Not on the map. Why?

Abstract (arXiv)

We present an implicit neural representation to learn the spatio-temporal space of kinematic motions. Unlike previous work that represents motion as discrete sequential samples, we propose to express the vast motion space as a continuous function over time, hence the name Neural Motion Fields (NeMF). Specifically, we use a neural network to learn this function for miscellaneous sets of motions, which is designed to be a generative model conditioned on a temporal coordinate t and a random vector z for controlling the style. The model is then trained as a Variational Autoencoder (VAE) with motion encoders to sample the latent space. We train our model with a diverse human motion dataset and quadruped dataset to prove its versatility, and finally deploy it as a generic motion prior to solve task-agnostic problems and show its superiority in different motion generation and editing applications, such as motion interpolation, in-betweening, and re-navigating. More details can be found on our project page: https://cs.yale.edu/homes/che/projects/nemf/.

Key facts. Cited by 68 papers in the map (data through 14 Oct 2026). Builds on 33 of its 83 references that are in the map. First posted on arXiv 4 Jun 2022.

Builds on

33 of 83 references.

References · 33

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  2. 2016Layer Normalizationcited by 5,669
  3. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  5. 2018Group Normalizationcited by 1,524
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  7. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  8. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  9. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  10. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  11. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  12. 2017On human motion prediction using recurrent neural networkscited by 338
21 more
  1. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
  2. 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 271
  3. 2021Robust Motion In-betweeningcited by 229
  4. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  5. 2019Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishingcited by 191
  6. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 185
  7. 2021Character Controllers Using Motion VAEscited by 184
  8. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 165
  9. 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
  10. 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
  11. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  12. 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 109
  13. 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
  14. 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
  15. 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
  16. 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
  17. 2020Convolutional Autoencoders for Human Motion Infillingcited by 73
  18. 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
  19. 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
  20. 2020Generative Tweening: Long-term Inbetweening of 3D Human Motionscited by 23
  21. 2021Learning Compositional Representation for 4D Captures with Neural ODEcited by 22

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 4; 2023: 12; 2024: 18; 2025: 20; 2026: 14.

68 papers.

Sort:

By area:

  1. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  2. 2022EDGE: Editable Dance Generation From Musiccited by 287
  3. 2023Object Motion Guided Human Motion Synthesiscited by 212
  4. 2023Controllable Human-Object Interaction Synthesiscited by 109
  5. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
  6. 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
  7. 2024Flexible Motion In-betweening with Diffusion Modelscited by 71
  8. 2023Single Motion Diffusioncited by 65
  9. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
  10. 2024ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactionscited by 57
  11. 2024Autonomous Character-Scene Interaction Synthesis from Text Instructioncited by 56
  12. 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 51
38 more
  1. 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
  2. 2025GENMO: A GENeralist Model for Human MOtioncited by 49
  3. 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
  4. 2023Task-Oriented Human-Object Interactions Generation with Implicit Neural Representationscited by 42
  5. 2023Generating Continual Human Motion in Diverse 3D Scenescited by 39
  6. 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 34
  7. 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
  8. 2024ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generationcited by 25
  9. 2023HMP: Hand Motion Priors for Pose and Shape Estimation from Videocited by 23
  10. 2024HUMOS: Human Motion Model Conditioned on Body Shapecited by 20
  11. 2023RSMT: Real-time Stylized Motion Transition for Characterscited by 19
  12. 2025HOIDiNi: Human-Object Interaction through Diffusion Noise Optimizationcited by 18
  13. 2024Synergistic Global-space Camera and Human Reconstruction from Videoscited by 17
  14. 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generationcited by 17
  15. 2023Example-based Motion Synthesis via Generative Motion Matchingcited by 16
  16. 2025SemGeoMo: Dynamic Contextual Human Motion Generation with Semantic and Geometric Guidancecited by 16
  17. 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
  18. 2024Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Modelcited by 13
  19. 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 12
  20. 2025Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motionscited by 11
  21. 2024Local Action-Guided Motion Diffusion Model for Text-to-Motion Generationcited by 10
  22. 2022PaCMO: Partner Dependent Human Motion Generation in Dyadic Human Activity using Neural Operatorscited by 8
  23. 2024Temporal Residual Jacobians For Rig-free Motion Transfercited by 7
  24. 20253D Human Interaction Generation: A Surveycited by 7
  25. 2025GenHOI: Generalizing Text-driven 4D Human-Object Interaction Synthesis for Unseen Objectscited by 7
  26. 2025Geometric Neural Distance Fields for Learning Human Motion Priorscited by 6
  27. 2025Waymo-3DSkelMo: A Multi-Agent 3D Skeletal Motion Dataset for Pedestrian Interaction Modeling in Autonomous Drivingcited by 5
  28. 2024Scalable Group Choreography via Variational Phase Manifold Learningcited by 4
  29. 2025SimGenHOI: Physically Realistic Whole-Body Humanoid-Object Interaction via Generative Modeling and Reinforcement Learningcited by 4
  30. 2025Towards Synthesized and Editable Motion In-Betweening Through Part-Wise Phase Representationcited by 3
  31. 2025DyCrowd: Towards Dynamic Crowd Reconstruction from a Large-scene Videocited by 3
  32. 2026Modeling 3D Pedestrian-Vehicle Interactions for Vehicle-Conditioned Pose Forecastingcited by 3
  33. 2026Neural Implicit Action Fields: From Discrete Waypoints to Continuous Functions for Vision-Language-Action Modelscited by 3
  34. 2023Utilizing Task-Generic Motion Prior to Recover Full-Body Motion from Very Sparse Signalscited by 2
  35. 2026Dynamic Worlds, Dynamic Humans: Generating Virtual Human-Scene Interaction Motion in Dynamic Scenescited by 2
  36. 2026AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusioncited by 2
  37. 2024MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifoldscited by 1
  38. 2024Dynamic Motion Synthesis: Masked Audio-Text Conditioned Spatio-Temporal Transformerscited by 1

50 most cited of 68 All 68 (JSON)