BiEquiFormer: Bi-Equivariant Representations for Global Point Cloud Registration
Not on the map. Why?
Abstract (arXiv)
The goal of this paper is to address the problem of global point cloud registration (PCR) i.e., finding the optimal alignment between point clouds irrespective of the initial poses of the scans. This problem is notoriously challenging for classical optimization methods due to computational constraints. First, we show that state-of-the-art deep learning methods suffer from huge performance degradation when the point clouds are arbitrarily placed in space. We propose that equivariant deep learning should be utilized for solving this task and we characterize the specific type of bi-equivariance of PCR. Then, we design BiEquiformer a novel and scalable bi-equivariant pipeline i.e. equivariant to the independent transformations of the input point clouds. While a naive approach would process the point clouds independently we design expressive bi-equivariant layers that fuse the information from both point clouds. This allows us to extract high-quality superpoint correspondences and in turn, robust point-cloud registration. Extensive comparisons against state-of-the-art methods show that our method achieves comparable performance in the canonical setting and superior performance in the robust setting in both the 3DMatch and the challenging low-overlap 3DLoMatch dataset.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 11 Jul 2024.
Builds on
39 of 65 references.
References · 39
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 318
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
- 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
- 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
27 more
- 2020Deep Global Registrationcited by 228
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 223
- 2022Geometric Transformer for Fast and Robust Point Cloud Registrationcited by 200
- 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 180
- 2020D3Feat: Joint Learning of Dense Detection and Description of 3D Local Featurescited by 175
- 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
- 2021CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registrationcited by 151
- 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
- 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 141
- 2018PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptorscited by 140
- 2020Feature-metric Registration: A Fast Semi-supervised Approach for Robust Point Cloud Registration without Correspondencescited by 108
- 20183DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registrationcited by 100
- 20193DRegNet: A Deep Neural Network for 3D Point Registrationcited by 96
- 2021Lepard: Learning partial point cloud matching in rigid and deformable scenescited by 85
- 2021Independent SE(3)-Equivariant Models for End-to-End Rigid Protein Dockingcited by 81
- 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
- 2019PCRNet: Point Cloud Registration Network using PointNet Encodingcited by 63
- 2022Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learningcited by 54
- 2023Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulationcited by 51
- 2024Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3Dcited by 32
- 2022PointConvFormer: Revenge of the Point-based Convolutioncited by 29
- 2022SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Spacecited by 26
- 2022RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registrationcited by 25
- 2023Banana: Banach Fixed-Point Network for Pointcloud Segmentation with Inter-Part Equivariancecited by 19
- 20223D Equivariant Graph Implicit Functionscited by 18
- 2018Analysis of Robust Functions for Registration Algorithmscited by 9
- 2023Pyramid Semantic Graph-based Global Point Cloud Registration with Low Overlapcited by 6
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 20243D Registration in 30 Years: A Surveycited by 2
- 20243D Registration in 30 Years: A Survey18 Dec 2024