PedRecNet: Multi-task deep neural network for full 3D human pose and orientation estimation
Not on the map. Why?
Abstract (arXiv)
We present a multitask network that supports various deep neural network based pedestrian detection functions. Besides 2D and 3D human pose, it also supports body and head orientation estimation based on full body bounding box input. This eliminates the need for explicit face recognition. We show that the performance of 3D human pose estimation and orientation estimation is comparable to the state-of-the-art. Since very few data sets exist for 3D human pose and in particular body and head orientation estimation based on full body data, we further show the benefit of particular simulation data to train the network. The network architecture is relatively simple, yet powerful, and easily adaptable for further research and applications.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 25 Apr 2022.
Builds on
31 of 49 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
- 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 223
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
19 more
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 114
- 20163D Human Pose Estimation = 2D Pose Estimation + Matchingcited by 112
- 20182D/3D Pose Estimation and Action Recognition using Multitask Deep Learningcited by 103
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 20183D Human Pose Estimation in the Wild by Adversarial Learningcited by 86
- 2019XNect: Real-time Multi-Person 3D Motion Capture with a Single RGB Cameracited by 68
- 2017Human Pose Regression by Combining Indirect Part Detection and Contextual Informationcited by 52
- 2016Deep Kinematic Pose Regressioncited by 40
- 2019Multi-task Deep Learning for Real-Time 3D Human Pose Estimation and Action Recognitioncited by 35
- 2022Multi-task head pose estimation in-the-wildcited by 22
- 2021Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimationcited by 18
- 2020MEBOW: Monocular Estimation of Body Orientation In the Wildcited by 14
- 2020Self-Paced Deep Regression Forests with Consideration on Underrepresented Examplescited by 10
- 2017Designing Deep Convolutional Neural Networks for Continuous Object Orientation Estimationcited by 6
- 2018Nose, eyes and ears: Head pose estimation by locating facial keypointscited by 6
- 2020Deep Convolutional Neural Network-based Bernoulli Heatmap for Head Pose Estimationcited by 3
- 2019Simple yet efficient real-time pose-based action recognitioncited by 2
- 2021An Efficient Multitask Neural Network for Face Alignment, Head Pose Estimation and Face Trackingcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 2.
4 papers.
- 2024RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Modelscited by 20
- 2022Joint Multi-Person Body Detection and Orientation Estimation via One Unified Embeddingcited by 3
- 2024Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Trainingcited by 2
- 2023Experimental Insights Towards Explainable and Interpretable Pedestrian Crossing Predictioncited by 1
- 2024RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models1 May 2024
- 2024Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training30 Apr 2024
- 2023Experimental Insights Towards Explainable and Interpretable Pedestrian Crossing Prediction5 Dec 2023
- 2022Joint Multi-Person Body Detection and Orientation Estimation via One Unified Embedding27 Oct 2022