Accurate Point Cloud Registration with Robust Optimal Transport
Not on the map. Why?
Abstract (arXiv)
This work investigates the use of robust optimal transport (OT) for shape matching. Specifically, we show that recent OT solvers improve both optimization-based and deep learning methods for point cloud registration, boosting accuracy at an affordable computational cost. This manuscript starts with a practical overview of modern OT theory. We then provide solutions to the main difficulties in using this framework for shape matching. Finally, we showcase the performance of transport-enhanced registration models on a wide range of challenging tasks: rigid registration for partial shapes; scene flow estimation on the Kitti dataset; and nonparametric registration of lung vascular trees between inspiration and expiration. Our OT-based methods achieve state-of-the-art results on Kitti and for the challenging lung registration task, both in terms of accuracy and scalability. We also release PVT1010, a new public dataset of 1,010 pairs of lung vascular trees with densely sampled points. This dataset provides a challenging use case for point cloud registration algorithms with highly complex shapes and deformations. Our work demonstrates that robust OT enables fast pre-alignment and fine-tuning for a wide range of registration models, thereby providing a new key method for the computer vision toolbox. Our code and dataset are available online at: https://github.com/uncbiag/robot.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 55 of its 136 references that are in the map. First posted on arXiv 1 Nov 2021.
Builds on
55 of 136 references.
References · 55
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
38 more
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 318
- 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
- 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
- 2020RPM-Net: Robust Point Matching using Learned Featurescited by 181
- 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 180
- 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
- 2016Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registrationcited by 159
- 2018SPLATNet: Sparse Lattice Networks for Point Cloud Processingcited by 158
- 2019PRNet: Self-Supervised Learning for Partial-to-Partial Registrationcited by 146
- 2018PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptorscited by 140
- 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 138
- 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
- 2020FLOT: Scene Flow on Point Clouds Guided by Optimal Transportcited by 129
- 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
- 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
- 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 108
- 2020Kernel Operations on the GPU, with Autodiff, without Memory Overflowscited by 101
- 2021A comprehensive survey on point cloud registrationcited by 84
- 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
- 2016Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problemscited by 69
- 2019Sliced Gromov-Wassersteincited by 66
- 2020The Unbalanced Gromov Wasserstein Distance: Conic Formulation and Relaxationcited by 55
- 2020Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernelscited by 53
- 2019Sinkhorn Divergences for Unbalanced Optimal Transportcited by 52
- 2020Outlier-Robust Optimal Transportcited by 45
- 2019Networks for Joint Affine and Non-parametric Image Registrationcited by 44
- 2018FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterizationcited by 43
- 2017Optimal Transport for Diffeomorphic Registrationcited by 39
- 2019A Polynomial-time Solution for Robust Registration with Extreme Outlier Ratescited by 38
- 2019PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Cloudscited by 38
- 2016Gaussian Process Morphable Modelscited by 31
- 2013The varifold representation of non-oriented shapes for diffeomorphic registrationcited by 24
- 2019Region-specific Diffeomorphic Metric Mappingcited by 24
- 2018Estimation of Large Motion in Lung CT by Integrating Regularized Keypoint Correspondences into Dense Deformable Registrationcited by 23
- 2021Fast and Scalable Optimal Transport for Brain Tractogramscited by 11
- 2021Deep learning based geometric registration for medical images: How accurate can we get without visual features?cited by 10
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2022: 2; 2023: 10; 2024: 11; 2025: 10; 2026: 5.
38 papers.
Sort:
By area:
- 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 40
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 37
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
- 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportationcited by 27
- 2023Quasi-Monte Carlo for 3D Sliced Wassersteincited by 22
- 2022Diffeomorphic Image Registration with Neural Velocity Fieldcited by 20
- 2024Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learningcited by 12
- 2025Joint Self-Supervised Video Alignment and Action Segmentationcited by 11
- 2023Brain-ID: Learning Contrast-agnostic Anatomical Representations for Brain Imagingcited by 10
- 2024Deep learning-driven pulmonary artery and vein segmentation reveals demography-associated vasculature anatomical differencescited by 9
- 2024Unsupervised Cross-Domain Image Retrieval via Prototypical Optimal Transportcited by 7
- 2023Efficient and Accurate Optimal Transport with Mirror Descent and Conjugate Gradientscited by 6
26 more
- 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imagingcited by 5
- 2024Optimal Transport on the Lie Group of Roto-translationscited by 4
- 2025Unraveling Normal Anatomy via Fluid-Driven Anomaly Randomizationcited by 4
- 2025Procedure Learning via Regularized Gromov-Wasserstein Optimal Transportcited by 4
- 2025Efficient Transferable Optimal Transport via Min-Sliced Transport Planscited by 4
- 2023Approximation properties of slice-matching operatorscited by 3
- 2024Unsupervised Solution Operator Learning for Mean-Field Games via Sampling-Invariant Parametrizationscited by 3
- 2024React-OT: Optimal Transport for Generating Transition State in Chemical Reactionscited by 3
- 2025APML: Adaptive Probabilistic Matching Loss for Robust 3D Point Cloud Reconstructioncited by 3
- 2023Graph Matching Optimization Network for Point Cloud Registrationcited by 2
- 2023Shape-Graph Matching Network (SGM-net): Registration for Statistical Shape Analysiscited by 2
- 2023Partial Transport for Point-Cloud Registrationcited by 2
- 2023A denoised Mean Teacher for domain adaptive point cloud registrationcited by 1
- 2024Learning signals defined on graphs with optimal transport and Gaussian process regressioncited by 1
- 2024PointVoxelFormer -- Reviving point cloud networks for 3D medical imagingcited by 1
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimationcited by 1
- 2023Hierarchical Attention and Graph Neural Networks: Toward Drift-Free Pose Estimationcited by 0
- 2024Interpretable deformable image registration: A geometric deep learning perspectivecited by 0
- 2025S2MNet: Speckle-To-Mesh Net for Three-Dimensional Cardiac Morphology Reconstruction via Echocardiogramcited by 0
- 2025Helping CLIP See Both the Forest and the Trees: A Decomposition and Description Approachcited by 0
- 2025VPREG: An Optimal Control Formulation for Diffeomorphic Image Registration Based on the Variational Principle Grid Generation Methodcited by 0
- 2025From Theory to Throughput: CUDA-Optimized APML for Large-Batch 3D Learningcited by 0
- 2026HOT-POT: Optimal Transport for Sparse Stereo Matchingcited by 0
- 2026Sinkhorn-CPD: Robust point cloud registration via unbalanced entropic optimal transportcited by 0
- 2026Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Densitycited by 0
- 2026Accelerated Algorithm for Sparse Regularized Partial Optimal Transportcited by 0
- 2026Accelerated Algorithm for Sparse Regularized Partial Optimal Transport30 Sep 2026
- 2026Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Density17 Aug 2026
- 2026Sinkhorn-CPD: Robust point cloud registration via unbalanced entropic optimal transport15 Jun 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 2026HOT-POT: Optimal Transport for Sparse Stereo Matching18 Jan 2026
- 2025From Theory to Throughput: CUDA-Optimized APML for Large-Batch 3D Learning17 Dec 2025
- 2025Efficient Transferable Optimal Transport via Min-Sliced Transport Plans24 Nov 2025
- 2025VPREG: An Optimal Control Formulation for Diffeomorphic Image Registration Based on the Variational Principle Grid Generation Method15 Oct 2025
- 2025APML: Adaptive Probabilistic Matching Loss for Robust 3D Point Cloud Reconstruction9 Sep 2025
- 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imaging30 Aug 2025
- 2025Procedure Learning via Regularized Gromov-Wasserstein Optimal Transport21 Jul 2025
- 2025Helping CLIP See Both the Forest and the Trees: A Decomposition and Description Approach4 Jul 2025
26 more
- 2025S2MNet: Speckle-To-Mesh Net for Three-Dimensional Cardiac Morphology Reconstruction via Echocardiogram9 May 2025
- 2025Joint Self-Supervised Video Alignment and Action Segmentation21 Mar 2025
- 2025Unraveling Normal Anatomy via Fluid-Driven Anomaly Randomization23 Jan 2025
- 2024PointVoxelFormer -- Reviving point cloud networks for 3D medical imaging23 Dec 2024
- 2024Interpretable deformable image registration: A geometric deep learning perspective17 Dec 2024
- 2024Learning signals defined on graphs with optimal transport and Gaussian process regression21 Oct 2024
- 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation5 Jul 2024
- 2024React-OT: Optimal Transport for Generating Transition State in Chemical Reactions20 Apr 2024
- 2024Deep learning-driven pulmonary artery and vein segmentation reveals demography-associated vasculature anatomical differences11 Apr 2024
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentation1 Apr 2024
- 2024Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learning4 Mar 2024
- 2024Unsupervised Cross-Domain Image Retrieval via Prototypical Optimal Transport28 Feb 2024
- 2024Optimal Transport on the Lie Group of Roto-translations23 Feb 2024
- 2024Unsupervised Solution Operator Learning for Mean-Field Games via Sampling-Invariant Parametrizations27 Jan 2024
- 2023Brain-ID: Learning Contrast-agnostic Anatomical Representations for Brain Imaging28 Nov 2023
- 2023Approximation properties of slice-matching operators16 Oct 2023
- 2023Partial Transport for Point-Cloud Registration27 Sep 2023
- 2023Quasi-Monte Carlo for 3D Sliced Wasserstein21 Sep 2023
- 2023Hierarchical Attention and Graph Neural Networks: Toward Drift-Free Pose Estimation18 Sep 2023
- 2023Shape-Graph Matching Network (SGM-net): Registration for Statistical Shape Analysis14 Aug 2023
- 2023Efficient and Accurate Optimal Transport with Mirror Descent and Conjugate Gradients17 Jul 2023
- 2023A denoised Mean Teacher for domain adaptive point cloud registration26 Jun 2023
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Survey8 May 2023
- 2023Graph Matching Optimization Network for Point Cloud Registration12 Feb 2023
- 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistency13 Jun 2022
- 2022Diffeomorphic Image Registration with Neural Velocity Field25 Feb 2022
- 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 40
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 37
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
- 2023Quasi-Monte Carlo for 3D Sliced Wassersteincited by 22
- 2022Diffeomorphic Image Registration with Neural Velocity Fieldcited by 20
- 2024Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learningcited by 12
- 2025Joint Self-Supervised Video Alignment and Action Segmentationcited by 11
- 2023Brain-ID: Learning Contrast-agnostic Anatomical Representations for Brain Imagingcited by 10
- 2024Deep learning-driven pulmonary artery and vein segmentation reveals demography-associated vasculature anatomical differencescited by 9
- 2024Unsupervised Cross-Domain Image Retrieval via Prototypical Optimal Transportcited by 7
- 2023Efficient and Accurate Optimal Transport with Mirror Descent and Conjugate Gradientscited by 6
- 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imagingcited by 5
12 most cited of 36 All 36 (JSON)
- 2026Accelerated Algorithm for Sparse Regularized Partial Optimal Transport30 Sep 2026
- 2026Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Density17 Aug 2026
- 2026Sinkhorn-CPD: Robust point cloud registration via unbalanced entropic optimal transport15 Jun 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 2026HOT-POT: Optimal Transport for Sparse Stereo Matching18 Jan 2026
- 2025From Theory to Throughput: CUDA-Optimized APML for Large-Batch 3D Learning17 Dec 2025
- 2025Efficient Transferable Optimal Transport via Min-Sliced Transport Plans24 Nov 2025
- 2025VPREG: An Optimal Control Formulation for Diffeomorphic Image Registration Based on the Variational Principle Grid Generation Method15 Oct 2025
- 2025APML: Adaptive Probabilistic Matching Loss for Robust 3D Point Cloud Reconstruction9 Sep 2025
- 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imaging30 Aug 2025
- 2025Procedure Learning via Regularized Gromov-Wasserstein Optimal Transport21 Jul 2025
- 2025S2MNet: Speckle-To-Mesh Net for Three-Dimensional Cardiac Morphology Reconstruction via Echocardiogram9 May 2025
12 newest of 36 All 36 (JSON)