mlsanityData to 7 Oct 2026

Point2SSM: Learning Morphological Variations of Anatomies from Point Cloud

arXiv 2305.14486 ↗First posted 23 May 2023cs.CV cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

We present Point2SSM, a novel unsupervised learning approach for constructing correspondence-based statistical shape models (SSMs) directly from raw point clouds. SSM is crucial in clinical research, enabling population-level analysis of morphological variation in bones and organs. Traditional methods of SSM construction have limitations, including the requirement of noise-free surface meshes or binary volumes, reliance on assumptions or templates, and prolonged inference times due to simultaneous optimization of the entire cohort. Point2SSM overcomes these barriers by providing a data-driven solution that infers SSMs directly from raw point clouds, reducing inference burdens and increasing applicability as point clouds are more easily acquired. While deep learning on 3D point clouds has seen success in unsupervised representation learning and shape correspondence, its application to anatomical SSM construction is largely unexplored. We conduct a benchmark of state-of-the-art point cloud deep networks on the SSM task, revealing their limited robustness to clinical challenges such as noisy, sparse, or incomplete input and limited training data. Point2SSM addresses these issues through an attention-based module, providing effective correspondence mappings from learned point features. Our results demonstrate that the proposed method significantly outperforms existing networks in terms of accurate surface sampling and correspondence, better capturing population-level statistics.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 41 of its 77 references that are in the map. First posted on arXiv 23 May 2023.

Builds on

41 of 77 references.

References · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  3. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  4. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  5. 2020Point Transformercited by 1,462
  6. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  7. 2018PCN: Point Completion Networkcited by 382
  8. 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
  9. 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
  10. 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
  11. 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
  12. 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
29 more
  1. 2017Deep Learning for Medical Image Processing: Overview, Challenges and Futurecited by 104
  2. 2019Learning elementary structures for 3D shape generation and matchingcited by 98
  3. 2019BAE-NET: Branched Autoencoder for Shape Co-Segmentationcited by 89
  4. 2018Discovery of Latent 3D Keypoints via End-to-end Geometric Reasoningcited by 79
  5. 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
  6. 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
  7. 2021KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Controlcited by 50
  8. 2020Correspondence Learning via Linearly-invariant Embeddingcited by 48
  9. 2020CorrNet3D: Unsupervised End-to-end Learning of Dense Correspondence for 3D Point Cloudscited by 47
  10. 2022Comprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysiscited by 44
  11. 2022PointAttN: You Only Need Attention for Point Cloud Completioncited by 43
  12. 2020Unsupervised Learning of Intrinsic Structural Representation Pointscited by 39
  13. 2020Dual Geometric Graph Network (DG2N) -- Iterative network for deformable shape alignmentcited by 35
  14. 2018DeepSSM: A Deep Learning Framework for Statistical Shape Modeling from Raw Imagescited by 32
  15. 2019Cyclic Functional Mapping: Self-supervised correspondence between non-isometric deformable shapescited by 30
  16. 2020Learning Implicit Functions for Topology-Varying Dense 3D Shape Correspondencecited by 27
  17. 2021DeepSSM: A Blueprint for Image-to-Shape Deep Learning Modelscited by 25
  18. 2020Unsupervised Learning of Category-Specific Symmetric 3D Keypoints from Point Setscited by 23
  19. 2021Learning 3D Dense Correspondence via Canonical Point Autoencodercited by 21
  20. 2020Uncertain-DeepSSM: From Images to Probabilistic Shape Modelscited by 20
  21. 2017Learning Local Shape Descriptors from Part Correspondences With Multi-view Convolutional Networkscited by 17
  22. 2022From Images to Probabilistic Anatomical Shapes: A Deep Variational Bottleneck Approachcited by 17
  23. 2023Mesh2SSM: From Surface Meshes to Statistical Shape Models of Anatomycited by 13
  24. 2020Probabilistic 3D surface reconstruction from sparse MRI informationcited by 12
  25. 2020Benchmarking off-the-shelf statistical shape modeling tools in clinical applicationscited by 11
  26. 2022Landmark-free Statistical Shape Modeling via Neural Flow Deformationscited by 11
  27. 2023S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondencescited by 11
  28. 2023Fully Bayesian VIB-DeepSSMcited by 11
  29. 2023Can point cloud networks learn statistical shape models of anatomies?cited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 5; 2026: 2.

14 papers.

Sort:

Similar, not cited

Close in wording, no citation either way

  1. 2023Progressive DeepSSM: Training Methodology for Image-To-Shape Deep Models
  2. 2024MASSM: An End-to-End Deep Learning Framework for Multi-Anatomy Statistical Shape Modeling Directly From Images
  3. 2023Image2SSM: Reimagining Statistical Shape Models from Images with Radial Basis Functions
  4. 2023ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images
  5. 2021Leveraging Unsupervised Image Registration for Discovery of Landmark Shape Descriptor
  6. 2025Hierarchical Feature Learning for Medical Point Clouds via State Space Model
  7. 2021Deep Implicit Statistical Shape Models for 3D Medical Image Delineation
  8. 2026Leveraging a Statistical Shape Model for Efficient Generation of Annotated Training Data: A Case Study on Liver Landmarks Segmentation