Learning multiview 3D point cloud registration
Not on the map. Why?
Abstract (arXiv)
We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm. Registration of multiple scans typically follows a two-stage pipeline: the initial pairwise alignment and the globally consistent refinement. The former is often ambiguous due to the low overlap of neighboring point clouds, symmetries and repetitive scene parts. Therefore, the latter global refinement aims at establishing the cyclic consistency across multiple scans and helps in resolving the ambiguous cases. In this paper we propose, to the best of our knowledge, the first end-to-end algorithm for joint learning of both parts of this two-stage problem. Experimental evaluation on well accepted benchmark datasets shows that our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly. Moreover, we present detailed analysis and an ablation study that validate the novel components of our approach. The source code and pretrained models are publicly available under https://github.com/zgojcic/3D_multiview_reg.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 14; 2023: 13; 2024: 15; 2025: 8; 2026: 1.
78 papers.
Sort:
By area:
- 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
- 2022REGTR: End-to-end Point Cloud Correspondences with Transformerscited by 94
- 2023SiLK -- Simple Learned Keypointscited by 54
- 2021Deep Hough Voting for Robust Global Registrationcited by 53
- 2021HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registrationcited by 47
- 2022Dynamic 3D Scene Analysis by Point Cloud Accumulationcited by 47
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
- 2021Sparse Auxiliary Networks for Unified Monocular Depth Prediction and Completioncited by 39
38 more
- 2021Quantum Permutation Synchronizationcited by 32
- 2021Projective Manifold Gradient Layer for Deep Rotation Regressioncited by 31
- 2021Multiway Non-rigid Point Cloud Registration via Learned Functional Map Synchronizationcited by 30
- 2021Bootstrap Your Own Correspondencescited by 27
- 2021Self-supervised Geometric Perceptioncited by 26
- 2021Dual Transformer for Point Cloud Analysiscited by 26
- 2022OGC: Unsupervised 3D Object Segmentation from Rigid Dynamics of Point Cloudscited by 24
- 2021HARA: A Hierarchical Approach for Robust Rotation Averagingcited by 22
- 2021PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Cloudscited by 20
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2022Reliable Inlier Evaluation for Unsupervised Point Cloud Registrationcited by 19
- 2022ImLoveNet: Misaligned Image-supported Registration Network for Low-overlap Point Cloud Pairscited by 17
- 2023Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweightingcited by 17
- 2022FisherMatch: Semi-Supervised Rotation Regression via Entropy-based Filteringcited by 16
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisitedcited by 16
- 2021Point Cloud Learning with Transformercited by 15
- 2022DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimizationcited by 14
- 2023PointMBF: A Multi-scale Bidirectional Fusion Network for Unsupervised RGB-D Point Cloud Registrationcited by 14
- 2024Multiway Point Cloud Mosaicking with Diffusion and Global Optimizationcited by 14
- 2021Learning Iterative Robust Transformation Synchronizationcited by 13
- 2022Improving RGB-D Point Cloud Registration by Learning Multi-scale Local Linear Transformationcited by 12
- 20213D Point Cloud Registration with Multi-Scale Architecture and Unsupervised Transfer Learningcited by 11
- 2022RAGO: Recurrent Graph Optimizer For Multiple Rotation Averagingcited by 10
- 2022Q-FW: A Hybrid Classical-Quantum Frank-Wolfe for Quadratic Binary Optimizationcited by 8
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matchingcited by 8
- 2021WSDesc: Weakly Supervised 3D Local Descriptor Learning for Point Cloud Registrationcited by 7
- 2023Multi-body SE(3) Equivariance for Unsupervised Rigid Segmentation and Motion Estimationcited by 7
- 2023Leveraging Large-Scale Pretrained Vision Foundation Models for Label-Efficient 3D Point Cloud Segmentationcited by 7
- 2021Full Transformer Framework for Robust Point Cloud Registration with Deep Information Interactioncited by 6
- 2024GeoNLF: Geometry guided Pose-Free Neural LiDAR Fieldscited by 6
- 2022Self-Supervised Correspondence Estimation via Multiview Registrationcited by 5
- 2025Quantum-enhanced Computer Vision: Going Beyond Classical Algorithmscited by 5
- 2022Collaborative Propagation on Multiple Instance Graphs for 3D Instance Segmentation with Single-point Supervisioncited by 4
- 2024SE(3)-bi-equivariant Transformers for Point Cloud Assemblycited by 4
- 2024Unsupervised Point Cloud Registration with Self-Distillationcited by 4
- 2023SyNDock: N Rigid Protein Docking via Learnable Group Synchronizationcited by 3
- 2023Weakly Supervised 3D Instance Segmentation without Instance-level Annotationscited by 3
- 2025FUSER: Feed-Forward MUltiview 3D Registration Transformer and SE(3)N Diffusion Refinementcited by 3
50 most cited of 78 All 78 (JSON)
- 2026Spectral Consistency-Guided Multiview Point Cloud Registration for Low-Overlap Scenes11 Sep 2026
- 2025FUSER: Feed-Forward MUltiview 3D Registration Transformer and SE(3)N Diffusion Refinement10 Dec 2025
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matching1 Dec 2025
- 2025Leveraging Cycle-Consistent Anchor Points for Self-Supervised RGB-D Registration16 Oct 2025
- 2025Quantum-enhanced Computer Vision: Going Beyond Classical Algorithms8 Oct 2025
- 2025Equivariant Flow Matching for Point Cloud Assembly24 May 2025
- 2025Matching Distance and Geometric Distribution Aided Learning Multiview Point Cloud Registration6 May 2025
- 2025Multiview Point Cloud Registration via Optimization in an Autoencoder Latent Space30 Apr 2025
- 2025SemanticFlow: A Self-Supervised Framework for Joint Scene Flow Prediction and Instance Segmentation in Dynamic Environments19 Mar 2025
- 20243D Registration in 30 Years: A Survey18 Dec 2024
- 2024Equi-GSPR: Equivariant SE(3) Graph Network Model for Sparse Point Cloud Registration8 Oct 2024
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisited23 Sep 2024
38 more
- 2024Multiple Rotation Averaging with Constrained Reweighting Deep Matrix Factorization15 Sep 2024
- 2024Unsupervised Point Cloud Registration with Self-Distillation11 Sep 2024
- 2024SE(3)-bi-equivariant Transformers for Point Cloud Assembly12 Jul 2024
- 2024Incremental Multiview Point Cloud Registration with Two-stage Candidate Retrieval10 Jul 2024
- 2024GeoNLF: Geometry guided Pose-Free Neural LiDAR Fields8 Jul 2024
- 2024Incremental Multiview Point Cloud Registration6 Jul 2024
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detection17 Jun 2024
- 2024L-PR: Exploiting LiDAR Fiducial Marker for Unordered Low Overlap Multiview Point Cloud Registration5 Jun 2024
- 2024Large-scale DSM registration via motion averaging29 May 2024
- 2024RGBD-Glue: General Feature Combination for Robust RGB-D Point Cloud Registration13 May 2024
- 2024F2M-Reg: Unsupervised RGB-D Point Cloud Registration with Frame-to-Model Optimization1 May 2024
- 2024Multiway Point Cloud Mosaicking with Diffusion and Global Optimization30 Mar 2024
- 2023Generalized Robot 3D Vision-Language Model with Fast Rendering and Pre-Training Vision-Language Alignment1 Dec 2023
- 2023Leveraging Large-Scale Pretrained Vision Foundation Models for Label-Efficient 3D Point Cloud Segmentation3 Nov 2023
- 2023HDMNet: A Hierarchical Matching Network with Double Attention for Large-scale Outdoor LiDAR Point Cloud Registration29 Oct 2023
- 2023Self-Supervised 3D Scene Flow Estimation and Motion Prediction using Local Rigidity Prior17 Oct 2023
- 2023Q-REG: End-to-End Trainable Point Cloud Registration with Surface Curvature27 Sep 2023
- 2023Overlap Bias Matching is Necessary for Point Cloud Registration18 Aug 2023
- 2023PointMBF: A Multi-scale Bidirectional Fusion Network for Unsupervised RGB-D Point Cloud Registration9 Aug 2023
- 2023Weakly Supervised 3D Instance Segmentation without Instance-level Annotations3 Aug 2023
- 2023A Strong Baseline for Point Cloud Registration via Direct Superpoints Matching3 Jul 2023
- 2023Multi-body SE(3) Equivariance for Unsupervised Rigid Segmentation and Motion Estimation8 Jun 2023
- 2023SyNDock: N Rigid Protein Docking via Learnable Group Synchronization23 May 2023
- 2023SiLK -- Simple Learned Keypoints12 Apr 2023
- 2023Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweighting2 Apr 2023
- 2022RAGO: Recurrent Graph Optimizer For Multiple Rotation Averaging14 Dec 2022
- 2022DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimization13 Dec 2022
- 2022Self-Supervised Correspondence Estimation via Multiview Registration6 Dec 2022
- 2022OGC: Unsupervised 3D Object Segmentation from Rigid Dynamics of Point Clouds10 Oct 2022
- 2022Improving RGB-D Point Cloud Registration by Learning Multi-scale Local Linear Transformation31 Aug 2022
- 2022Collaborative Propagation on Multiple Instance Graphs for 3D Instance Segmentation with Single-point Supervision10 Aug 2022
- 2022Dynamic 3D Scene Analysis by Point Cloud Accumulation25 Jul 2022
- 2022Accurate Ground-Truth Depth Image Generation via Overfit Training of Point Cloud Registration using Local Frame Sets14 Jul 2022
- 2022ImLoveNet: Misaligned Image-supported Registration Network for Low-overlap Point Cloud Pairs2 Jul 2022
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Picking14 Apr 2022
- 2022FisherMatch: Semi-Supervised Rotation Regression via Entropy-based Filtering29 Mar 2022
- 2022REGTR: End-to-end Point Cloud Correspondences with Transformers28 Mar 2022
- 2022Q-FW: A Hybrid Classical-Quantum Frank-Wolfe for Quadratic Binary Optimization23 Mar 2022
50 newest of 78 All 78 (JSON)
- 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
- 2022REGTR: End-to-end Point Cloud Correspondences with Transformerscited by 94
- 2023SiLK -- Simple Learned Keypointscited by 54
- 2021Deep Hough Voting for Robust Global Registrationcited by 53
- 2021HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registrationcited by 47
- 2022Dynamic 3D Scene Analysis by Point Cloud Accumulationcited by 47
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
- 2021Sparse Auxiliary Networks for Unified Monocular Depth Prediction and Completioncited by 39
12 most cited of 75 All 75 (JSON)
- 2026Spectral Consistency-Guided Multiview Point Cloud Registration for Low-Overlap Scenes11 Sep 2026
- 2025FUSER: Feed-Forward MUltiview 3D Registration Transformer and SE(3)N Diffusion Refinement10 Dec 2025
- 2025Leveraging Cycle-Consistent Anchor Points for Self-Supervised RGB-D Registration16 Oct 2025
- 2025Quantum-enhanced Computer Vision: Going Beyond Classical Algorithms8 Oct 2025
- 2025Matching Distance and Geometric Distribution Aided Learning Multiview Point Cloud Registration6 May 2025
- 2025Multiview Point Cloud Registration via Optimization in an Autoencoder Latent Space30 Apr 2025
- 2025SemanticFlow: A Self-Supervised Framework for Joint Scene Flow Prediction and Instance Segmentation in Dynamic Environments19 Mar 2025
- 20243D Registration in 30 Years: A Survey18 Dec 2024
- 2024Equi-GSPR: Equivariant SE(3) Graph Network Model for Sparse Point Cloud Registration8 Oct 2024
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisited23 Sep 2024
- 2024Multiple Rotation Averaging with Constrained Reweighting Deep Matrix Factorization15 Sep 2024
- 2024Unsupervised Point Cloud Registration with Self-Distillation11 Sep 2024
12 newest of 75 All 75 (JSON)