mlsanityData to 7 Oct 2026

Neural Kinematic Networks for Unsupervised Motion Retargetting

arXiv 1804.05653 ↗First posted 16 Apr 2018cs.CVcited by 85

Not on the map. Why?

Abstract (arXiv)

We propose a recurrent neural network architecture with a Forward Kinematics layer and cycle consistency based adversarial training objective for unsupervised motion retargetting. Our network captures the high-level properties of an input motion by the forward kinematics layer, and adapts them to a target character with different skeleton bone lengths (e.g., shorter, longer arms etc.). Collecting paired motion training sequences from different characters is expensive. Instead, our network utilizes cycle consistency to learn to solve the Inverse Kinematics problem in an unsupervised manner. Our method works online, i.e., it adapts the motion sequence on-the-fly as new frames are received. In our experiments, we use the Mixamo animation data to test our method for a variety of motions and characters and achieve state-of-the-art results. We also demonstrate motion retargetting from monocular human videos to 3D characters using an off-the-shelf 3D pose estimator.

Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 18; 2022: 16; 2023: 19; 2024: 10; 2025: 10; 2026: 12.

85 papers.

Sort:

By area:

  1. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  2. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  3. 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
  4. 2022Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generationcited by 106
  5. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
  6. 2022Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtubecited by 79
  7. 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 66
  8. 2023Single Motion Diffusioncited by 65
  9. 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
  10. 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 57
  11. 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recoverycited by 48
  12. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 48
38 more
  1. 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
  2. 2023Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometrycited by 35
  3. 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
  4. 2021Contact-Aware Retargeting of Skinned Motioncited by 31
  5. 2022Skeleton-free Pose Transfer for Stylized 3D Characterscited by 29
  6. 2022Pretrained Diffusion Models for Unified Human Motion Synthesiscited by 26
  7. 2025A Survey on Human Interaction Motion Generationcited by 25
  8. 2022GANimator: Neural Motion Synthesis from a Single Sequencecited by 23
  9. 2022ViA: View-invariant Skeleton Action Representation Learning via Motion Retargetingcited by 22
  10. 2022Action-conditioned On-demand Motion Generationcited by 18
  11. 2023Improving 3D Pose Estimation for Sign Languagecited by 16
  12. 2021Action2video: Generating Videos of Human 3D Actionscited by 15
  13. 2023LAC: Latent Action Composition for Skeleton-based Action Segmentationcited by 15
  14. 2023UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletonscited by 15
  15. 2024WalkTheDog: Cross-Morphology Motion Alignment via Phase Manifoldscited by 14
  16. 2021MoCaNet: Motion Retargeting in-the-wild via Canonicalization Networkscited by 13
  17. 2024STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargetingcited by 13
  18. 2024Skinned Motion Retargeting with Dense Geometric Interaction Perceptioncited by 13
  19. 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characterscited by 12
  20. 2021Deep Feedback Inverse Problem Solvercited by 11
  21. 2021FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstructioncited by 11
  22. 2023ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Spacecited by 11
  23. 2021Conditional Temporal Variational AutoEncoder for Action Video Predictioncited by 9
  24. 2023Pose-aware Attention Network for Flexible Motion Retargeting by Body Partcited by 9
  25. 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulationcited by 9
  26. 2021A Shape-Aware Retargeting Approach to Transfer Human Motion and Appearance in Monocular Videoscited by 8
  27. 2022The Best of Both Worlds: Combining Model-based and Nonparametric Approaches for 3D Human Body Estimationcited by 8
  28. 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Priorcited by 8
  29. 2021Self-Supervised Motion Retargeting with Safety Guaranteecited by 6
  30. 2021Neural Human Deformation Transfercited by 6
  31. 2022FusePose: IMU-Vision Sensor Fusion in Kinematic Space for Parametric Human Pose Estimationcited by 6
  32. 2023Correspondence-free online human motion retargetingcited by 6
  33. 2023Semantics-aware Motion Retargeting with Vision-Language Modelscited by 6
  34. 2024Neural Pose Representation Learning for Generating and Transferring Non-Rigid Object Posescited by 6
  35. 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planningcited by 6
  36. 2023HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargetingcited by 5
  37. 2024Motion Keyframe Interpolation for Any Human Skeleton via Temporally Consistent Point Cloud Sampling and Reconstructioncited by 5
  38. 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animationcited by 5

50 most cited of 85 All 85 (JSON)