3D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinement
Not on the map. Why?
Abstract (arXiv)
In the field of 3D Human Pose Estimation (HPE), accurately estimating human pose, especially in scenarios with occlusions, is a significant challenge. This work identifies and addresses a gap in the current state of the art in 3D HPE concerning the scarcity of data and strategies for handling occlusions. We introduce our novel BlendMimic3D dataset, designed to mimic real-world situations where occlusions occur for seamless integration in 3D HPE algorithms. Additionally, we propose a 3D pose refinement block, employing a Graph Convolutional Network (GCN) to enhance pose representation through a graph model. This GCN block acts as a plug-and-play solution, adaptable to various 3D HPE frameworks without requiring retraining them. By training the GCN with occluded data from BlendMimic3D, we demonstrate significant improvements in resolving occluded poses, with comparable results for non-occluded ones. Project web page is available at https://blendmimic3d.github.io/BlendMimic3D/.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 24 Apr 2024.
Builds on
31 of 44 references.
References · 31
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Mask R-CNNcited by 7,259
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2019On the Convergence of Adam and Beyondcited by 834
- 2015An Introduction to Convolutional Neural Networkscited by 510
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
19 more
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
- 2017Learning from Synthetic Humanscited by 358
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 2016RMPE: Regional Multi-person Pose Estimationcited by 340
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2019Exploiting temporal context for 3D human pose estimation in the wildcited by 110
- 2018Ordinal Depth Supervision for 3D Human Pose Estimationcited by 107
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 81
- 2017Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Imagecited by 73
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
- 2016PoseTrack: Joint Multi-Person Pose Estimation and Trackingcited by 44
- 2018How Robust is 3D Human Pose Estimation to Occlusion?cited by 23
- 2020Graph and Temporal Convolutional Networks for 3D Multi-person Pose Estimation in Monocular Videoscited by 23
- 2018Bottom-up Pose Estimation of Multiple Person with Bounding Box Constraintcited by 4
Built on by
Citing papers per year: 2025: 2.
2 papers.