mlsanityData to 7 Oct 2026

BiEquiFormer: Bi-Equivariant Representations for Global Point Cloud Registration

arXiv 2407.08729 ↗First posted 11 Jul 2024cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

The goal of this paper is to address the problem of global point cloud registration (PCR) i.e., finding the optimal alignment between point clouds irrespective of the initial poses of the scans. This problem is notoriously challenging for classical optimization methods due to computational constraints. First, we show that state-of-the-art deep learning methods suffer from huge performance degradation when the point clouds are arbitrarily placed in space. We propose that equivariant deep learning should be utilized for solving this task and we characterize the specific type of bi-equivariance of PCR. Then, we design BiEquiformer a novel and scalable bi-equivariant pipeline i.e. equivariant to the independent transformations of the input point clouds. While a naive approach would process the point clouds independently we design expressive bi-equivariant layers that fuse the information from both point clouds. This allows us to extract high-quality superpoint correspondences and in turn, robust point-cloud registration. Extensive comparisons against state-of-the-art methods show that our method achieves comparable performance in the canonical setting and superior performance in the robust setting in both the 3DMatch and the challenging low-overlap 3DLoMatch dataset.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 11 Jul 2024.

Builds on

39 of 65 references.

References · 39

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  3. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  4. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  5. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  6. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  7. 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
  8. 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 318
  9. 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
  10. 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
  11. 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
  12. 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
27 more
  1. 2020Deep Global Registrationcited by 228
  2. 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 223
  3. 2022Geometric Transformer for Fast and Robust Point Cloud Registrationcited by 200
  4. 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 180
  5. 2020D3Feat: Joint Learning of Dense Detection and Description of 3D Local Featurescited by 175
  6. 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
  7. 2021CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registrationcited by 151
  8. 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
  9. 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 141
  10. 2018PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptorscited by 140
  11. 2020Feature-metric Registration: A Fast Semi-supervised Approach for Robust Point Cloud Registration without Correspondencescited by 108
  12. 20183DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registrationcited by 100
  13. 20193DRegNet: A Deep Neural Network for 3D Point Registrationcited by 96
  14. 2021Lepard: Learning partial point cloud matching in rigid and deformable scenescited by 85
  15. 2021Independent SE(3)-Equivariant Models for End-to-End Rigid Protein Dockingcited by 81
  16. 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
  17. 2019PCRNet: Point Cloud Registration Network using PointNet Encodingcited by 63
  18. 2022Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learningcited by 54
  19. 2023Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulationcited by 51
  20. 2024Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3Dcited by 32
  21. 2022PointConvFormer: Revenge of the Point-based Convolutioncited by 29
  22. 2022SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Spacecited by 26
  23. 2022RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registrationcited by 25
  24. 2023Banana: Banach Fixed-Point Network for Pointcloud Segmentation with Inter-Part Equivariancecited by 19
  25. 20223D Equivariant Graph Implicit Functionscited by 18
  26. 2018Analysis of Robust Functions for Registration Algorithmscited by 9
  27. 2023Pyramid Semantic Graph-based Global Point Cloud Registration with Low Overlapcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.