mlsanityData to 7 Oct 2026

Accurate Point Cloud Registration with Robust Optimal Transport

arXiv 2111.00648 ↗First posted 1 Nov 2021cs.CV cs.CGcited by 38

Not on the map. Why?

Abstract (arXiv)

This work investigates the use of robust optimal transport (OT) for shape matching. Specifically, we show that recent OT solvers improve both optimization-based and deep learning methods for point cloud registration, boosting accuracy at an affordable computational cost. This manuscript starts with a practical overview of modern OT theory. We then provide solutions to the main difficulties in using this framework for shape matching. Finally, we showcase the performance of transport-enhanced registration models on a wide range of challenging tasks: rigid registration for partial shapes; scene flow estimation on the Kitti dataset; and nonparametric registration of lung vascular trees between inspiration and expiration. Our OT-based methods achieve state-of-the-art results on Kitti and for the challenging lung registration task, both in terms of accuracy and scalability. We also release PVT1010, a new public dataset of 1,010 pairs of lung vascular trees with densely sampled points. This dataset provides a challenging use case for point cloud registration algorithms with highly complex shapes and deformations. Our work demonstrates that robust OT enables fast pre-alignment and fine-tuning for a wide range of registration models, thereby providing a new key method for the computer vision toolbox. Our code and dataset are available online at: https://github.com/uncbiag/robot.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 55 of its 136 references that are in the map. First posted on arXiv 1 Nov 2021.

Builds on

55 of 136 references.

References · 55

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  5. 2018Neural Ordinary Differential Equationscited by 3,733
  6. 2017Billion-scale similarity search with GPUscited by 2,477
  7. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  8. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  9. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  10. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  11. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  12. 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
38 more
  1. 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
  2. 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 318
  3. 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
  4. 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
  5. 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
  6. 2020RPM-Net: Robust Point Matching using Learned Featurescited by 181
  7. 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 180
  8. 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
  9. 2016Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registrationcited by 159
  10. 2018SPLATNet: Sparse Lattice Networks for Point Cloud Processingcited by 158
  11. 2019PRNet: Self-Supervised Learning for Partial-to-Partial Registrationcited by 146
  12. 2018PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptorscited by 140
  13. 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 138
  14. 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
  15. 2020FLOT: Scene Flow on Point Clouds Guided by Optimal Transportcited by 129
  16. 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
  17. 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
  18. 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 108
  19. 2020Kernel Operations on the GPU, with Autodiff, without Memory Overflowscited by 101
  20. 2021A comprehensive survey on point cloud registrationcited by 84
  21. 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
  22. 2016Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problemscited by 69
  23. 2019Sliced Gromov-Wassersteincited by 66
  24. 2020The Unbalanced Gromov Wasserstein Distance: Conic Formulation and Relaxationcited by 55
  25. 2020Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernelscited by 53
  26. 2019Sinkhorn Divergences for Unbalanced Optimal Transportcited by 52
  27. 2020Outlier-Robust Optimal Transportcited by 45
  28. 2019Networks for Joint Affine and Non-parametric Image Registrationcited by 44
  29. 2018FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterizationcited by 43
  30. 2017Optimal Transport for Diffeomorphic Registrationcited by 39
  31. 2019A Polynomial-time Solution for Robust Registration with Extreme Outlier Ratescited by 38
  32. 2019PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Cloudscited by 38
  33. 2016Gaussian Process Morphable Modelscited by 31
  34. 2013The varifold representation of non-oriented shapes for diffeomorphic registrationcited by 24
  35. 2019Region-specific Diffeomorphic Metric Mappingcited by 24
  36. 2018Estimation of Large Motion in Lung CT by Integrating Regularized Keypoint Correspondences into Dense Deformable Registrationcited by 23
  37. 2021Fast and Scalable Optimal Transport for Brain Tractogramscited by 11
  38. 2021Deep learning based geometric registration for medical images: How accurate can we get without visual features?cited by 10

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 10; 2024: 11; 2025: 10; 2026: 5.

38 papers.

Sort:

By area:

  1. 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 40
  2. 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 37
  3. 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
  4. 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportationcited by 27
  5. 2023Quasi-Monte Carlo for 3D Sliced Wassersteincited by 22
  6. 2022Diffeomorphic Image Registration with Neural Velocity Fieldcited by 20
  7. 2024Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learningcited by 12
  8. 2025Joint Self-Supervised Video Alignment and Action Segmentationcited by 11
  9. 2023Brain-ID: Learning Contrast-agnostic Anatomical Representations for Brain Imagingcited by 10
  10. 2024Deep learning-driven pulmonary artery and vein segmentation reveals demography-associated vasculature anatomical differencescited by 9
  11. 2024Unsupervised Cross-Domain Image Retrieval via Prototypical Optimal Transportcited by 7
  12. 2023Efficient and Accurate Optimal Transport with Mirror Descent and Conjugate Gradientscited by 6
26 more
  1. 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imagingcited by 5
  2. 2024Optimal Transport on the Lie Group of Roto-translationscited by 4
  3. 2025Unraveling Normal Anatomy via Fluid-Driven Anomaly Randomizationcited by 4
  4. 2025Procedure Learning via Regularized Gromov-Wasserstein Optimal Transportcited by 4
  5. 2025Efficient Transferable Optimal Transport via Min-Sliced Transport Planscited by 4
  6. 2023Approximation properties of slice-matching operatorscited by 3
  7. 2024Unsupervised Solution Operator Learning for Mean-Field Games via Sampling-Invariant Parametrizationscited by 3
  8. 2024React-OT: Optimal Transport for Generating Transition State in Chemical Reactionscited by 3
  9. 2025APML: Adaptive Probabilistic Matching Loss for Robust 3D Point Cloud Reconstructioncited by 3
  10. 2023Graph Matching Optimization Network for Point Cloud Registrationcited by 2
  11. 2023Shape-Graph Matching Network (SGM-net): Registration for Statistical Shape Analysiscited by 2
  12. 2023Partial Transport for Point-Cloud Registrationcited by 2
  13. 2023A denoised Mean Teacher for domain adaptive point cloud registrationcited by 1
  14. 2024Learning signals defined on graphs with optimal transport and Gaussian process regressioncited by 1
  15. 2024PointVoxelFormer -- Reviving point cloud networks for 3D medical imagingcited by 1
  16. 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimationcited by 1
  17. 2023Hierarchical Attention and Graph Neural Networks: Toward Drift-Free Pose Estimationcited by 0
  18. 2024Interpretable deformable image registration: A geometric deep learning perspectivecited by 0
  19. 2025S2MNet: Speckle-To-Mesh Net for Three-Dimensional Cardiac Morphology Reconstruction via Echocardiogramcited by 0
  20. 2025Helping CLIP See Both the Forest and the Trees: A Decomposition and Description Approachcited by 0
  21. 2025VPREG: An Optimal Control Formulation for Diffeomorphic Image Registration Based on the Variational Principle Grid Generation Methodcited by 0
  22. 2025From Theory to Throughput: CUDA-Optimized APML for Large-Batch 3D Learningcited by 0
  23. 2026HOT-POT: Optimal Transport for Sparse Stereo Matchingcited by 0
  24. 2026Sinkhorn-CPD: Robust point cloud registration via unbalanced entropic optimal transportcited by 0
  25. 2026Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Densitycited by 0
  26. 2026Accelerated Algorithm for Sparse Regularized Partial Optimal Transportcited by 0