DefTransNet: A Transformer-based Method for Non-Rigid Point Cloud Registration in the Simulation of Soft Tissue Deformation
Not on the map. Why?
Abstract (arXiv)
Soft-tissue surgeries, such as tumor resections, are complicated by tissue deformations that can obscure the accurate location and shape of tissues. By representing tissue surfaces as point clouds and applying non-rigid point cloud registration (PCR) methods, surgeons can better understand tissue deformations before, during, and after surgery. Existing non-rigid PCR methods, such as feature-based approaches, struggle with robustness against challenges like noise, outliers, partial data, and large deformations, making accurate point correspondence difficult. Although learning-based PCR methods, particularly Transformer-based approaches, have recently shown promise due to their attention mechanisms for capturing interactions, their robustness remains limited in challenging scenarios. In this paper, we present DefTransNet, a novel end-to-end Transformer-based architecture for non-rigid PCR. DefTransNet is designed to address the key challenges of deformable registration, including large deformations, outliers, noise, and partial data, by inputting source and target point clouds and outputting displacement vector fields. The proposed method incorporates a learnable transformation matrix to enhance robustness to affine transformations, integrates global and local geometric information, and captures long-range dependencies among points using Transformers. We validate our approach on four datasets: ModelNet, SynBench, 4DMatch, and DeformedTissue, using both synthetic and real-world data to demonstrate the generalization of our proposed method. Experimental results demonstrate that DefTransNet outperforms current state-of-the-art registration networks across various challenging conditions. Our code and data are publicly available.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 59 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
33 of 59 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2020Point Transformercited by 1,462
- 2015Spatial Transformer Networkscited by 1,423
- 2020PCT: Point cloud transformercited by 730
- 2017Learning from Synthetic Humanscited by 358
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 318
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
21 more
- 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
- 2021CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registrationcited by 151
- 2019PRNet: Self-Supervised Learning for Partial-to-Partial Registrationcited by 146
- 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 141
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
- 2022REGTR: End-to-end Point Cloud Correspondences with Transformerscited by 94
- 2021Lepard: Learning partial point cloud matching in rigid and deformable scenescited by 85
- 2021A comprehensive survey on point cloud registrationcited by 84
- 2019DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Datacited by 76
- 2022A Survey of Non-Rigid 3D Registrationcited by 59
- 2022Non-rigid Point Cloud Registration with Neural Deformation Pyramidcited by 41
- 2021ReAgent: Point Cloud Registration using Imitation and Reinforcement Learningcited by 23
- 2023Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registrationcited by 14
- 2021Deep learning based geometric registration for medical images: How accurate can we get without visual features?cited by 10
- 2023Neural Intrinsic Embedding for Non-rigid Point Cloud Matchingcited by 9
- 2019Learning Deformable Point Set Registration with Regularized Dynamic Graph CNNs for Large Lung Motion in COPD Patientscited by 8
- 2021Unsupervised Diffeomorphic Surface Registration and Non-Linear Modellingcited by 8
- 2020DeepCLR: Correspondence-Less Architecture for Deep End-to-End Point Cloud Registrationcited by 7
- 2023Robust-DefReg: A Robust Deformable Point Cloud Registration Method based on Graph Convolutional Neural Networkscited by 4
- 2022TransBoost: Improving the Best ImageNet Performance using Deep Transductioncited by 3
- 2023Learning Functional Transductioncited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.