ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematics
Not on the map. Why?
Abstract (arXiv)
Our work focuses on the development of a learnable neural representation of human pose for advanced AI assisted animation tooling. Specifically, we tackle the problem of constructing a full static human pose based on sparse and variable user inputs (e.g. locations and/or orientations of a subset of body joints). To solve this problem, we propose a novel neural architecture that combines residual connections with prototype encoding of a partially specified pose to create a new complete pose from the learned latent space. We show that our architecture outperforms a baseline based on Transformer, both in terms of accuracy and computational efficiency. Additionally, we develop a user interface to integrate our neural model in Unity, a real-time 3D development platform. Furthermore, we introduce two new datasets representing the static human pose modeling problem, based on high-quality human motion capture data, which will be released publicly along with model code.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 22 of its 52 references that are in the map. First posted on arXiv 3 Jun 2021.
Builds on
22 of 52 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2017Deep Setscited by 1,394
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
10 more
- 2021Robust Motion In-betweeningcited by 223
- 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
- 2021LoBSTr: Real-time Lower-body Pose Prediction from Sparse Upper-body Tracking Signalscited by 45
- 2018Real-time Deep Pose Estimation with Geodesic Loss for Image-to-Template Rigid Registrationcited by 40
- 2016Space-Time Representation of People Based on 3D Skeletal Data: A Reviewcited by 24
- 2020Graph and Temporal Convolutional Networks for 3D Multi-person Pose Estimation in Monocular Videoscited by 23
- 2021FixMyPose: Pose Correctional Captioning and Retrievalcited by 12
- 2013Classifying and Visualizing Motion Capture Sequences using Deep Neural Networkscited by 3
- 2019Metric Pose Estimation for Human-Machine Interaction Using Monocular Visioncited by 2
- 2020AnimGAN: A Spatiotemporally-Conditioned Generative Adversarial Network for Character Animationcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 5; 2024: 5; 2025: 3; 2026: 2.
17 papers.
Sort:
By area:
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesiscited by 44
- 2024HanDiffuser: Text-to-Image Generation With Realistic Hand Appearancescited by 42
- 2023Iterative Motion Editing with Natural Languagecited by 39
- 2023PoseFix: Correcting 3D Human Poses with Natural Languagecited by 38
- 2022Pretrained Diffusion Models for Unified Human Motion Synthesiscited by 26
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modelingcited by 7
- 2024Inverse Kinematics for Neuro-Robotic Grasping with Humanoid Embodied Agentscited by 7
- 2022SMPL-IK: Learned Morphology-Aware Inverse Kinematics for AI Driven Artistic Workflowscited by 5
- 2023CycleIK: Neuro-inspired Inverse Kinematicscited by 5
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 4
5 more
- 2024DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimizationcited by 3
- 2025Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematicscited by 2
- 2024MODL: Multilearner Online Deep Learningcited by 1
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editingcited by 1
- 2025Probabilistic Pretraining for Neural Regressioncited by 0
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning29 May 2026
- 2025Probabilistic Pretraining for Neural Regression22 Aug 2025
- 2025Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematics19 Aug 2025
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Prediction23 Mar 2025
- 2024MODL: Multilearner Online Deep Learning28 May 2024
- 2024DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimization29 Apr 2024
- 2024Inverse Kinematics for Neuro-Robotic Grasping with Humanoid Embodied Agents12 Apr 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2024HanDiffuser: Text-to-Image Generation With Realistic Hand Appearances4 Mar 2024
- 2023Iterative Motion Editing with Natural Language15 Dec 2023
- 2023PoseFix: Correcting 3D Human Poses with Natural Language15 Sep 2023
5 more
- 2023CycleIK: Neuro-inspired Inverse Kinematics21 Jul 2023
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation15 May 2023
- 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesis21 Apr 2023
- 2022Pretrained Diffusion Models for Unified Human Motion Synthesis6 Dec 2022
- 2022SMPL-IK: Learned Morphology-Aware Inverse Kinematics for AI Driven Artistic Workflows16 Aug 2022
- 2024HanDiffuser: Text-to-Image Generation With Realistic Hand Appearancescited by 42
- 2023Iterative Motion Editing with Natural Languagecited by 39
- 2022Pretrained Diffusion Models for Unified Human Motion Synthesiscited by 26
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesiscited by 44
- 2023PoseFix: Correcting 3D Human Poses with Natural Languagecited by 38
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modelingcited by 7
- 2024Inverse Kinematics for Neuro-Robotic Grasping with Humanoid Embodied Agentscited by 7
- 2022SMPL-IK: Learned Morphology-Aware Inverse Kinematics for AI Driven Artistic Workflowscited by 5
- 2023CycleIK: Neuro-inspired Inverse Kinematicscited by 5
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 4
- 2024DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimizationcited by 3
- 2025Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematicscited by 2
- 2024MODL: Multilearner Online Deep Learningcited by 1
12 most cited of 14 All 14 (JSON)
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning29 May 2026
- 2025Probabilistic Pretraining for Neural Regression22 Aug 2025
- 2025Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematics19 Aug 2025
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Prediction23 Mar 2025
- 2024MODL: Multilearner Online Deep Learning28 May 2024
- 2024DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimization29 Apr 2024
- 2024Inverse Kinematics for Neuro-Robotic Grasping with Humanoid Embodied Agents12 Apr 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2023PoseFix: Correcting 3D Human Poses with Natural Language15 Sep 2023
- 2023CycleIK: Neuro-inspired Inverse Kinematics21 Jul 2023
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation15 May 2023
12 newest of 14 All 14 (JSON)