Point2SSM: Learning Morphological Variations of Anatomies from Point Cloud
Not on the map. Why?
Abstract (arXiv)
We present Point2SSM, a novel unsupervised learning approach for constructing correspondence-based statistical shape models (SSMs) directly from raw point clouds. SSM is crucial in clinical research, enabling population-level analysis of morphological variation in bones and organs. Traditional methods of SSM construction have limitations, including the requirement of noise-free surface meshes or binary volumes, reliance on assumptions or templates, and prolonged inference times due to simultaneous optimization of the entire cohort. Point2SSM overcomes these barriers by providing a data-driven solution that infers SSMs directly from raw point clouds, reducing inference burdens and increasing applicability as point clouds are more easily acquired. While deep learning on 3D point clouds has seen success in unsupervised representation learning and shape correspondence, its application to anatomical SSM construction is largely unexplored. We conduct a benchmark of state-of-the-art point cloud deep networks on the SSM task, revealing their limited robustness to clinical challenges such as noisy, sparse, or incomplete input and limited training data. Point2SSM addresses these issues through an attention-based module, providing effective correspondence mappings from learned point features. Our results demonstrate that the proposed method significantly outperforms existing networks in terms of accurate surface sampling and correspondence, better capturing population-level statistics.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 41 of its 77 references that are in the map. First posted on arXiv 23 May 2023.
Builds on
41 of 77 references.
References · 41
- 2017Attention Is All You Needcited by 59,932
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2020Point Transformercited by 1,462
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2018PCN: Point Completion Networkcited by 382
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
- 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
- 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
- 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
- 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
29 more
- 2017Deep Learning for Medical Image Processing: Overview, Challenges and Futurecited by 104
- 2019Learning elementary structures for 3D shape generation and matchingcited by 98
- 2019BAE-NET: Branched Autoencoder for Shape Co-Segmentationcited by 89
- 2018Discovery of Latent 3D Keypoints via End-to-end Geometric Reasoningcited by 79
- 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
- 2021KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Controlcited by 50
- 2020Correspondence Learning via Linearly-invariant Embeddingcited by 48
- 2020CorrNet3D: Unsupervised End-to-end Learning of Dense Correspondence for 3D Point Cloudscited by 47
- 2022Comprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysiscited by 44
- 2022PointAttN: You Only Need Attention for Point Cloud Completioncited by 43
- 2020Unsupervised Learning of Intrinsic Structural Representation Pointscited by 39
- 2020Dual Geometric Graph Network (DG2N) -- Iterative network for deformable shape alignmentcited by 35
- 2018DeepSSM: A Deep Learning Framework for Statistical Shape Modeling from Raw Imagescited by 32
- 2019Cyclic Functional Mapping: Self-supervised correspondence between non-isometric deformable shapescited by 30
- 2020Learning Implicit Functions for Topology-Varying Dense 3D Shape Correspondencecited by 27
- 2021DeepSSM: A Blueprint for Image-to-Shape Deep Learning Modelscited by 25
- 2020Unsupervised Learning of Category-Specific Symmetric 3D Keypoints from Point Setscited by 23
- 2021Learning 3D Dense Correspondence via Canonical Point Autoencodercited by 21
- 2020Uncertain-DeepSSM: From Images to Probabilistic Shape Modelscited by 20
- 2017Learning Local Shape Descriptors from Part Correspondences With Multi-view Convolutional Networkscited by 17
- 2022From Images to Probabilistic Anatomical Shapes: A Deep Variational Bottleneck Approachcited by 17
- 2023Mesh2SSM: From Surface Meshes to Statistical Shape Models of Anatomycited by 13
- 2020Probabilistic 3D surface reconstruction from sparse MRI informationcited by 12
- 2020Benchmarking off-the-shelf statistical shape modeling tools in clinical applicationscited by 11
- 2022Landmark-free Statistical Shape Modeling via Neural Flow Deformationscited by 11
- 2023S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondencescited by 11
- 2023Fully Bayesian VIB-DeepSSMcited by 11
- 2023Can point cloud networks learn statistical shape models of anatomies?cited by 9
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 5; 2026: 2.
14 papers.
Sort:
- 2024DV-Matcher: Deformation-based Non-Rigid Point Cloud Matching Guided by Pre-trained Visual Featurescited by 10
- 2023Modeling 3D cardiac contraction and relaxation with point cloud deformation networkscited by 7
- 2024Point2SSM++: Self-Supervised Learning of Anatomical Shape Models from Point Cloudscited by 5
- 2024Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Imagescited by 4
- 2024SCorP: Statistics-Informed Dense Correspondence Prediction Directly from Unsegmented Medical Imagescited by 3
- 2025ToothForge: Automatic Dental Shape Generation using Synchronized Spectral Embeddingscited by 3
- 2025Mesh2SSM++: A Probabilistic Framework for Unsupervised Learning of Statistical Shape Model of Anatomies from Surface Meshescited by 2
- 2025Technologies on Effectiveness and Efficiency: A Survey of State Spaces Modelscited by 2
- 2024Probabilistic 3D Correspondence Prediction from Sparse Unsegmented Imagescited by 0
- 2024On the Viability of Semi-Supervised Segmentation Methods for Statistical Shape Modelingcited by 0
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generationcited by 0
- 2025NFR: Neural Feature-Guided Non-Rigid Shape Registrationcited by 0
- 2026TRACE: Artifact-Robust Statistical Shape Modeling from Imperfect Surface Scans - A Case Study in Craniosynostosis 3D Photography22 Aug 2026
- 2026SCALP: Semi-Supervised Statistical Shape Modeling from Imperfect 3D Photogrammetry via Landmark-Anchored Spectral Warp31 Jul 2026
- 2025ToothForge: Automatic Dental Shape Generation using Synchronized Spectral Embeddings3 Jun 2025
- 2025NFR: Neural Feature-Guided Non-Rigid Shape Registration28 May 2025
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generation6 Apr 2025
- 2025Technologies on Effectiveness and Efficiency: A Survey of State Spaces Models14 Mar 2025
- 2025Mesh2SSM++: A Probabilistic Framework for Unsupervised Learning of Statistical Shape Model of Anatomies from Surface Meshes11 Feb 2025
- 2024DV-Matcher: Deformation-based Non-Rigid Point Cloud Matching Guided by Pre-trained Visual Features16 Aug 2024
- 2024On the Viability of Semi-Supervised Segmentation Methods for Statistical Shape Modeling21 Jul 2024
- 2024Probabilistic 3D Correspondence Prediction from Sparse Unsegmented Images2 Jul 2024
- 2024Point2SSM++: Self-Supervised Learning of Anatomical Shape Models from Point Clouds15 May 2024
- 2024Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images15 May 2024
- 2024DV-Matcher: Deformation-based Non-Rigid Point Cloud Matching Guided by Pre-trained Visual Featurescited by 10
- 2023Modeling 3D cardiac contraction and relaxation with point cloud deformation networkscited by 7
- 2024Point2SSM++: Self-Supervised Learning of Anatomical Shape Models from Point Cloudscited by 5
- 2024Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Imagescited by 4
- 2024SCorP: Statistics-Informed Dense Correspondence Prediction Directly from Unsegmented Medical Imagescited by 3
- 2025ToothForge: Automatic Dental Shape Generation using Synchronized Spectral Embeddingscited by 3
- 2025Mesh2SSM++: A Probabilistic Framework for Unsupervised Learning of Statistical Shape Model of Anatomies from Surface Meshescited by 2
- 2025Technologies on Effectiveness and Efficiency: A Survey of State Spaces Modelscited by 2
- 2024Probabilistic 3D Correspondence Prediction from Sparse Unsegmented Imagescited by 0
- 2024On the Viability of Semi-Supervised Segmentation Methods for Statistical Shape Modelingcited by 0
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generationcited by 0
- 2025NFR: Neural Feature-Guided Non-Rigid Shape Registrationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026TRACE: Artifact-Robust Statistical Shape Modeling from Imperfect Surface Scans - A Case Study in Craniosynostosis 3D Photography22 Aug 2026
- 2026SCALP: Semi-Supervised Statistical Shape Modeling from Imperfect 3D Photogrammetry via Landmark-Anchored Spectral Warp31 Jul 2026
- 2025ToothForge: Automatic Dental Shape Generation using Synchronized Spectral Embeddings3 Jun 2025
- 2025NFR: Neural Feature-Guided Non-Rigid Shape Registration28 May 2025
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generation6 Apr 2025
- 2025Technologies on Effectiveness and Efficiency: A Survey of State Spaces Models14 Mar 2025
- 2025Mesh2SSM++: A Probabilistic Framework for Unsupervised Learning of Statistical Shape Model of Anatomies from Surface Meshes11 Feb 2025
- 2024DV-Matcher: Deformation-based Non-Rigid Point Cloud Matching Guided by Pre-trained Visual Features16 Aug 2024
- 2024On the Viability of Semi-Supervised Segmentation Methods for Statistical Shape Modeling21 Jul 2024
- 2024Probabilistic 3D Correspondence Prediction from Sparse Unsegmented Images2 Jul 2024
- 2024Point2SSM++: Self-Supervised Learning of Anatomical Shape Models from Point Clouds15 May 2024
- 2024Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images15 May 2024
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Progressive DeepSSM: Training Methodology for Image-To-Shape Deep Models
- 2024MASSM: An End-to-End Deep Learning Framework for Multi-Anatomy Statistical Shape Modeling Directly From Images
- 2023Image2SSM: Reimagining Statistical Shape Models from Images with Radial Basis Functions
- 2023ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images
- 2021Leveraging Unsupervised Image Registration for Discovery of Landmark Shape Descriptor
- 2025Hierarchical Feature Learning for Medical Point Clouds via State Space Model
- 2021Deep Implicit Statistical Shape Models for 3D Medical Image Delineation
- 2026Leveraging a Statistical Shape Model for Efficient Generation of Annotated Training Data: A Case Study on Liver Landmarks Segmentation