Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematics
Not on the map. Why?
Abstract (arXiv)
In 3D human pose and shape estimation, SMPLify remains a robust baseline that solves inverse kinematics (IK) through iterative optimization. However, its high computational cost limits its practicality. Recent advances across domains have shown that replacing iterative optimization with data-driven neural networks can achieve significant runtime improvements without sacrificing accuracy. Motivated by this trend, we propose Learnable SMPLify, a neural framework that replaces the iterative fitting process in SMPLify with a single-pass regression model. The design of our framework targets two core challenges in neural IK: data construction and generalization. To enable effective training, we propose a temporal sampling strategy that constructs initialization-target pairs from sequential frames. To improve generalization across diverse motions and unseen poses, we propose a human-centric normalization scheme and residual learning to narrow the solution space. Learnable SMPLify supports both sequential inference and plug-in post-processing to refine existing image-based estimators. Extensive experiments demonstrate that our method establishes itself as a practical and simple baseline: it achieves nearly 200x faster runtime compared to SMPLify, generalizes well to unseen 3DPW and RICH, and operates in a model-agnostic manner when used as a plug-in tool on LucidAction. The code is available at https://github.com/Charrrrrlie/Learnable-SMPLify.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 19 Aug 2025.
Builds on
42 of 64 references.
References · 42
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 337
30 more
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 307
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 242
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2018Learning a SAT Solver from Single-Bit Supervisioncited by 200
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 155
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 130
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 101
- 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
- 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
- 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
- 2020Human Body Model Fitting by Learned Gradient Descentcited by 81
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 76
- 2024CameraHMR: Aligning People with Perspectivecited by 65
- 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
- 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 32
- 2021KAMA: 3D Keypoint Aware Body Mesh Articulationcited by 27
- 2022PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body Estimationcited by 18
- 2021ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematicscited by 17
- 2025AniCrafter: Customizing Realistic Human-Centric Animation via Avatar-Background Conditioning in Video Diffusion Modelscited by 10
- 2022SMPL-IK: Learned Morphology-Aware Inverse Kinematics for AI Driven Artistic Workflowscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.