mlsanityData to 14 Oct 2026

3D Keypoint Estimation Using Implicit Representation Learning

arXiv 2306.11529 ↗First posted 20 Jun 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we tackle the challenging problem of 3D keypoint estimation of general objects using a novel implicit representation. Previous works have demonstrated promising results for keypoint prediction through direct coordinate regression or heatmap-based inference. However, these methods are commonly studied for specific subjects, such as human bodies and faces, which possess fixed keypoint structures. They also suffer in several practical scenarios where explicit or complete geometry is not given, including images and partial point clouds. Inspired by the recent success of advanced implicit representation in reconstruction tasks, we explore the idea of using an implicit field to represent keypoints. Specifically, our key idea is employing spheres to represent 3D keypoints, thereby enabling the learnability of the corresponding signed distance field. Explicit keypoints can be extracted subsequently by our algorithm based on the Hough transform. Quantitative and qualitative evaluations also show the superiority of our representation in terms of prediction accuracy.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 61 references that are in the map. First posted on arXiv 20 Jun 2023.

Builds on

35 of 61 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  6. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  8. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  9. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  10. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
  11. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
  12. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
23 more
  1. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 221
  2. 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
  3. 2020SMOKE: Single-Stage Monocular 3D Object Detection via Keypoint Estimationcited by 204
  4. 2017Towards Accurate Multi-person Pose Estimation in the Wildcited by 131
  5. 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
  6. 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
  7. 2019Self-Supervised Learning of 3D Human Pose using Multi-view Geometrycited by 98
  8. 2018Recurrent Slice Networks for 3D Segmentation of Point Cloudscited by 82
  9. 2018Discovery of Latent 3D Keypoints via End-to-end Geometric Reasoningcited by 79
  10. 2019Sim2real transfer learning for 3D human pose estimation: motion to the rescuecited by 76
  11. 2018Making Deep Heatmaps Robust to Partial Occlusions for 3D Object Pose Estimationcited by 74
  12. 2019USIP: Unsupervised Stable Interest Point Detection from 3D Point Cloudscited by 70
  13. 2015Flowing ConvNets for Human Pose Estimation in Videoscited by 55
  14. 2016Human pose estimation via Convolutional Part Heatmap Regressioncited by 51
  15. 2020KeypointNet: A Large-scale 3D Keypoint Dataset Aggregated from Numerous Human Annotationscited by 51
  16. 2017Learning Compact Geometric Featurescited by 45
  17. 2019Monocular 3D Object Detection via Geometric Reasoning on Keypointscited by 31
  18. 2021Skeleton Merger: an Unsupervised Aligned Keypoint Detectorcited by 27
  19. 2020Unsupervised Learning of Category-Specific Symmetric 3D Keypoints from Point Setscited by 23
  20. 2019Multi-Person 3D Human Pose Estimation from Monocular Imagescited by 19
  21. 2021ME-PCN: Point Completion Conditioned on Mask Emptinesscited by 18
  22. 2017Unsupervised Domain Adaptation for 3D Keypoint Estimation via View Consistencycited by 14
  23. 2020Combining 3D Model Contour Energy and Keypoints for Object Trackingcited by 5

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025KeyPointDiffuser: Unsupervised 3D Keypoint Learning via Latent Diffusion Modelscited by 0