ReFit: Recurrent Fitting Network for 3D Human Recovery
Not on the map. Why?
Abstract (arXiv)
We present Recurrent Fitting (ReFit), a neural network architecture for single-image, parametric 3D human reconstruction. ReFit learns a feedback-update loop that mirrors the strategy of solving an inverse problem through optimization. At each iterative step, it reprojects keypoints from the human model to feature maps to query feedback, and uses a recurrent-based updater to adjust the model to fit the image better. Because ReFit encodes strong knowledge of the inverse problem, it is faster to train than previous regression models. At the same time, ReFit improves state-of-the-art performance on standard benchmarks. Moreover, ReFit applies to other optimization settings, such as multi-view fitting and single-view shape fitting. Project website: https://yufu-wang.github.io/refit_humans/
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). Builds on 54 of its 74 references that are in the map. First posted on arXiv 22 Aug 2023.
Builds on
54 of 74 references.
References · 54
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
38 more
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 337
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2018Learning 3D Human Dynamics from Videocited by 316
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 307
- 2021Mesh Graphormercited by 265
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 2017Learned Primal-dual Reconstructioncited by 251
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2014Efficient Object Localization Using Convolutional Networkscited by 227
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 163
- 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
- 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
- 2020Coherent Reconstruction of Multiple Humans from a Single Imagecited by 136
- 2015Human Pose Estimation with Iterative Error Feedbackcited by 121
- 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
- 2020Exemplar Fine-Tuning for 3D Human Model Fitting Towards In-the-Wild 3D Human Pose Estimationcited by 113
- 2019Exploiting temporal context for 3D human pose estimation in the wildcited by 110
- 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
- 2021On Self-Contact and Human Posecited by 89
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
- 2019Fast and Robust Multi-Person 3D Pose Estimation from Multiple Viewscited by 83
- 2020Human Body Model Fitting by Learned Gradient Descentcited by 81
- 2020Neural Descent for Visual 3D Human Pose and Shapecited by 60
- 2020Human Mesh Recovery from Multiple Shotscited by 52
- 2022Coupled Iterative Refinement for 6D Multi-Object Pose Estimationcited by 48
- 2020Beyond Weak Perspective for Monocular 3D Human Pose Estimationcited by 29
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 17; 2025: 15; 2026: 11.
47 papers.
Sort:
By area:
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 76
- 2024CameraHMR: Aligning People with Perspectivecited by 65
- 2025GENMO: A GENeralist Model for Human MOtioncited by 49
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2024iHuman: Instant Animatable Digital Humans From Monocular Videoscited by 17
- 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
- 2024PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environmentscited by 11
- 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
35 more
- 2026UniSH: Unifying Scene and Human Reconstruction in a Feed-Forward Passcited by 9
- 2024MeshPose: Unifying DensePose and 3D Body Mesh reconstructioncited by 8
- 2025HoliGS: Holistic Gaussian Splatting for Embodied View Synthesiscited by 7
- 2024Optimal-state Dynamics Estimation for Physics-based Human Motion Capture from Videoscited by 6
- 2025DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recoverycited by 6
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyondcited by 5
- 2024EgoPoseFormer: A Simple Baseline for Stereo Egocentric 3D Human Pose Estimationcited by 4
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recoverycited by 4
- 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generationcited by 4
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Imagescited by 4
- 2026OnlineHMR: Video-based Online World-Grounded Human Mesh Recoverycited by 4
- 2023W-HMR: Monocular Human Mesh Recovery in World Space with Weak-Supervised Calibrationcited by 3
- 2025PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensingcited by 3
- 2026QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capturecited by 3
- 2024Multi-Human Mesh Recovery with Transformerscited by 2
- 2025Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematicscited by 2
- 2025PHD: Personalized 3D Human Body Fitting with Point Diffusioncited by 2
- 2025SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recoverycited by 2
- 2026GRAFT: Geometric Refinement and Fitting Transformer for Human Scene Reconstructioncited by 2
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recoverycited by 1
- 2024A vision-based framework for human behavior understanding in industrial assembly linescited by 1
- 2024Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Modelscited by 1
- 2024D-PoSE: Depth as an Intermediate Representation for 3D Human Pose and Shape Estimationcited by 1
- 2025Learning Efficient and Generalizable Human Representation with Human Gaussian Modelcited by 1
- 2026MoViD: View-Invariant 3D Human Pose Estimation via Motion-View Disentanglementcited by 1
- 2026UniCon3R: Unified Contact-aware 4D Human-Scene Reconstruction from Monocular Videocited by 1
- 2026Anny-Fit: All-Age Human Mesh Recoverycited by 1
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capturecited by 1
- 2023Temporal-Aware Refinement for Video-based Human Pose and Shape Recoverycited by 0
- 2024Multi-RoI Human Mesh Recovery with Camera Consistency and Contrastive Lossescited by 0
- 2025ANTHROPOS-V: benchmarking the novel task of Crowd Volume Estimationcited by 0
- 2025WATCH: World-aware Allied Trajectory and pose reConstruction for Camera and Humancited by 0
- 2025From Camera to World: A Plug-and-Play Module for Human Mesh Transformationcited by 0
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capturecited by 0
- 2026Meta-Learned Adaptive Optimization for Robust Human Mesh Recovery with Uncertainty-Aware Parameter Updatescited by 0
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Anny-Fit: All-Age Human Mesh Recovery6 May 2026
- 2026UniCon3R: Unified Contact-aware 4D Human-Scene Reconstruction from Monocular Video21 Apr 2026
- 2026GRAFT: Geometric Refinement and Fitting Transformer for Human Scene Reconstruction21 Apr 2026
- 2026MoViD: View-Invariant 3D Human Pose Estimation via Motion-View Disentanglement29 Mar 2026
- 2026Meta-Learned Adaptive Optimization for Robust Human Mesh Recovery with Uncertainty-Aware Parameter Updates27 Mar 2026
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
- 2026OnlineHMR: Video-based Online World-Grounded Human Mesh Recovery18 Mar 2026
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capture10 Mar 2026
- 2026QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capture27 Jan 2026
- 2026UniSH: Unifying Scene and Human Reconstruction in a Feed-Forward Pass3 Jan 2026
- 2025From Camera to World: A Plug-and-Play Module for Human Mesh Transformation17 Dec 2025
35 more
- 2025SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery25 Nov 2025
- 2025WATCH: World-aware Allied Trajectory and pose reConstruction for Camera and Human4 Sep 2025
- 2025PHD: Personalized 3D Human Body Fitting with Point Diffusion28 Aug 2025
- 2025Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematics19 Aug 2025
- 2025Learning Efficient and Generalizable Human Representation with Human Gaussian Model24 Jul 2025
- 2025HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis24 Jun 2025
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Images11 Jun 2025
- 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generation9 Jun 2025
- 2025GENMO: A GENeralist Model for Human MOtion2 May 2025
- 2025CoMotion: Concurrent Multi-person 3D Motion16 Apr 2025
- 2025PromptHMR: Promptable Human Mesh Recovery8 Apr 2025
- 2025DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recovery3 Apr 2025
- 2025PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensing27 Feb 2025
- 2025ANTHROPOS-V: benchmarking the novel task of Crowd Volume Estimation3 Jan 2025
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery25 Nov 2024
- 2024PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environments24 Nov 2024
- 2024CameraHMR: Aligning People with Perspective12 Nov 2024
- 2024Optimal-state Dynamics Estimation for Physics-based Human Motion Capture from Videos10 Oct 2024
- 2024D-PoSE: Depth as an Intermediate Representation for 3D Human Pose and Shape Estimation7 Oct 2024
- 2024Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Models1 Oct 2024
- 2024A vision-based framework for human behavior understanding in industrial assembly lines25 Sep 2024
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinates10 Sep 2024
- 2024iHuman: Instant Animatable Digital Humans From Monocular Videos15 Jul 2024
- 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image26 Jun 2024
- 2024MeshPose: Unifying DensePose and 3D Body Mesh reconstruction14 Jun 2024
- 2024EgoPoseFormer: A Simple Baseline for Stereo Egocentric 3D Human Pose Estimation26 Mar 2024
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos26 Mar 2024
- 2024Score-Guided Diffusion for 3D Human Recovery14 Mar 2024
- 2024Multi-Human Mesh Recovery with Transformers26 Feb 2024
- 2024Multi-RoI Human Mesh Recovery with Camera Consistency and Contrastive Losses3 Feb 2024
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery25 Jan 2024
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion12 Dec 2023
- 2023W-HMR: Monocular Human Mesh Recovery in World Space with Weak-Supervised Calibration29 Nov 2023
- 2023GART: Gaussian Articulated Template Models27 Nov 2023
- 2023Temporal-Aware Refinement for Video-based Human Pose and Shape Recovery16 Nov 2023
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
- 2024Score-Guided Diffusion for 3D Human Recovery14 Mar 2024
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 76
- 2024CameraHMR: Aligning People with Perspectivecited by 65
- 2025GENMO: A GENeralist Model for Human MOtioncited by 49
- 2024iHuman: Instant Animatable Digital Humans From Monocular Videoscited by 17
- 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
- 2024PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environmentscited by 11
- 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
- 2026UniSH: Unifying Scene and Human Reconstruction in a Feed-Forward Passcited by 9
12 most cited of 44 All 44 (JSON)
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Anny-Fit: All-Age Human Mesh Recovery6 May 2026
- 2026UniCon3R: Unified Contact-aware 4D Human-Scene Reconstruction from Monocular Video21 Apr 2026
- 2026GRAFT: Geometric Refinement and Fitting Transformer for Human Scene Reconstruction21 Apr 2026
- 2026MoViD: View-Invariant 3D Human Pose Estimation via Motion-View Disentanglement29 Mar 2026
- 2026Meta-Learned Adaptive Optimization for Robust Human Mesh Recovery with Uncertainty-Aware Parameter Updates27 Mar 2026
- 2026OnlineHMR: Video-based Online World-Grounded Human Mesh Recovery18 Mar 2026
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capture10 Mar 2026
- 2026QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capture27 Jan 2026
- 2026UniSH: Unifying Scene and Human Reconstruction in a Feed-Forward Pass3 Jan 2026
- 2025From Camera to World: A Plug-and-Play Module for Human Mesh Transformation17 Dec 2025
- 2025SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery25 Nov 2025
12 newest of 44 All 44 (JSON)