SE-Sync: A Certifiably Correct Algorithm for Synchronization over the Special Euclidean Group
Not on the map. Why?
Abstract (arXiv)
Many important geometric estimation problems take the form of synchronization over the special Euclidean group: estimate the values of a set of poses given a set of relative measurements between them. This problem is typically formulated as a nonconvex maximum-likelihood estimation that is computationally hard to solve in general. Nevertheless, in this paper we present an algorithm that is able to efficiently recover certifiably globally optimal solutions of the special Euclidean synchronization problem in a non-adversarial noise regime. The crux of our approach is the development of a semidefinite relaxation of the maximum-likelihood estimation whose minimizer provides an exact MLE so long as the magnitude of the noise corrupting the available measurements falls below a certain critical threshold; furthermore, whenever exactness obtains, it is possible to verify this fact a posteriori, thereby certifying the optimality of the recovered estimate. We develop a specialized optimization scheme for solving large-scale instances of this relaxation by exploiting its low-rank, geometric, and graph-theoretic structure to reduce it to an equivalent optimization problem on a low-dimensional Riemannian manifold, and design a truncated-Newton trust-region method to solve this reduction efficiently. Finally, we combine this fast optimization approach with a simple rounding procedure to produce our algorithm, SE-Sync. Experimental evaluation on a variety of simulated and real-world pose-graph SLAM datasets shows that SE-Sync is able to recover certifiably globally optimal solutions when the available measurements are corrupted by noise up to an order of magnitude greater than that typically encountered in robotics and computer vision applications, and does so more than an order of magnitude faster than the Gauss-Newton-based approach that forms the basis of current state-of-the-art techniques.
Key facts. Cited by 80 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 18; 2023: 10; 2024: 8; 2025: 11; 2026: 9.
80 papers.
Sort:
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 65
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 54
- 2021HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registrationcited by 48
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagationcited by 33
- 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFscited by 33
- 2021Quantum Permutation Synchronizationcited by 32
- 2021HARA: A Hierarchical Approach for Robust Rotation Averagingcited by 23
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimizationcited by 21
- 2022Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certificationcited by 21
- 2021PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Cloudscited by 20
38 more
- 2021Hybrid Rotation Averaging: A Fast and Robust Rotation Averaging Approachcited by 19
- 2021Distributional Depth-Based Estimation of Object Articulation Modelscited by 18
- 2021Advances in Inference and Representation for Simultaneous Localization and Mappingcited by 16
- 2022Quantum Motion Segmentationcited by 16
- 2021Optimal Pose and Shape Estimation for Category-level 3D Object Perceptioncited by 15
- 2021Rotation Coordinate Descent for Fast Globally Optimal Rotation Averagingcited by 14
- 2022MatchNorm: Learning-based Point Cloud Registration for 6D Object Pose Estimation in the Real Worldcited by 13
- 2022Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterizationcited by 13
- 2026Advances in Global Solvers for 3D Visioncited by 13
- 2021Rotation Averaging in a Split Second: A Primal-Dual Method and a Closed-Form for Cycle Graphscited by 12
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2024GlobalPointer: Large-Scale Plane Adjustment with Bi-Convex Relaxationcited by 11
- 2021An Inexact Projected Gradient Method with Rounding and Lifting by Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of Polynomial Optimizationcited by 10
- 2022A Robot Web for Distributed Many-Device Localisationcited by 9
- 2022Snapshot of Algebraic Visioncited by 9
- 2024A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Partscited by 9
- 2025Building Rome with Convex Optimizationcited by 8
- 2021On the Tightness of Semidefinite Relaxations for Rotation Estimationcited by 7
- 2021Full Transformer Framework for Robust Point Cloud Registration with Deep Information Interactioncited by 7
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypointscited by 7
- 2022A Deep Moving-camera Background Modelcited by 6
- 2021Fast and Robust Certifiable Estimation of the Relative Pose Between Two Calibrated Camerascited by 5
- 2021Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regimecited by 5
- 2024An Overview of the Burer-Monteiro Method for Certifiable Robot Perceptioncited by 5
- 2021Orthogonal Group Synchronization with Incomplete Measurements: Error Bounds and Linear Convergence of the Generalized Power Methodcited by 4
- 2022RL-PGO: Reinforcement Learning-based Planar Pose-Graph Optimizationcited by 4
- 2022Tight Certification of Adversarially Trained Neural Networks via Nonconvex Low-Rank Semidefinite Relaxationscited by 4
- 2023From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguationcited by 4
- 2023Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketchingcited by 4
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelinescited by 4
- 2022Accelerating Certifiable Estimation with Preconditioned Eigensolverscited by 3
- 2023ReSync: Riemannian Subgradient-based Robust Rotation Synchronizationcited by 3
- 2023HDMNet: A Hierarchical Matching Network with Double Attention for Large-scale Outdoor LiDAR Point Cloud Registrationcited by 3
- 2024Tensor-Based Synchronization and the Low-Rankness of the Block Trifocal Tensorcited by 3
- 2025Category-Level Object Shape and Pose Estimation in Less Than a Millisecondcited by 3
- 2021Sparse Multi-Reference Alignment : Phase Retrieval, Uniform Uncertainty Principles and the Beltway Problemcited by 2
- 2022Towards Understanding The Semidefinite Relaxations of Truncated Least-Squares in Robust Rotation Searchcited by 2
- 2025Certifiably Optimal Anisotropic Rotation Averagingcited by 2
50 most cited of 80 All 80 (JSON)
- 2026(DNN)2: Doubly Non-Negative Relaxations for Deep Neural Networks25 Aug 2026
- 2026HETA++: Global Structure-from-Motion with Hybrid Explicit Translation Averaging17 Jul 2026
- 2026TriP: A Triangle Puzzle Approach to Robust Translation Averaging8 May 2026
- 2026NS-RGS: Newton-Schulz based Riemannian gradient method for orthogonal group synchronization7 Apr 2026
- 2026Certifiable Factor Graph Optimization1 Mar 2026
- 2026QuadSync: Quadrifocal Tensor Synchronization via Tucker Decomposition26 Feb 2026
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2026Incremental Mapping with Measurement Synchronization & Compression8 Feb 2026
- 2026Dual Quaternion SE(3) Synchronization with Recovery Guarantees30 Jan 2026
- 2025Sparse Variable Projection in Robotic Perception: Exploiting Separable Structure for Efficient Nonlinear Optimization8 Dec 2025
- 2025Practical and Performant Enhancements for Maximization of Algebraic Connectivity11 Nov 2025
- 2025Learning from Frustration: Torsor CNNs on Graphs27 Oct 2025
38 more
- 2025FastJAM: a Fast Joint Alignment Model for Images26 Oct 2025
- 2025Category-Level Object Shape and Pose Estimation in Less Than a Millisecond23 Sep 2025
- 2025Fast globally optimal Truncated Least Squares point cloud registration with fixed rotation axis21 Aug 2025
- 2025Making Rotation Averaging Fast and Robust with Anisotropic Coordinate Descent2 Jun 2025
- 2025Higher-Order Group Synchronization28 May 2025
- 2025Certifiably Optimal Anisotropic Rotation Averaging10 Mar 2025
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines4 Mar 2025
- 2025Building Rome with Convex Optimization7 Feb 2025
- 2024A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Parts18 Oct 2024
- 2024The State of Julia for Scientific Machine Learning14 Oct 2024
- 2024An Overview of the Burer-Monteiro Method for Certifiable Robot Perception30 Sep 2024
- 2024Tensor-Based Synchronization and the Low-Rankness of the Block Trifocal Tensor14 Sep 2024
- 2024GlobalPointer: Large-Scale Plane Adjustment with Bi-Convex Relaxation18 Jul 2024
- 2024Rotation Averaging: A Primal-Dual Method and Closed-Forms in Cycle Graphs29 May 2024
- 2024Convex Relaxation for Solving Large-Margin Classifiers in Hyperbolic Space27 May 2024
- 2024VICAN: Very Efficient Calibration Algorithm for Large Camera Networks25 Mar 2024
- 2023Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketching19 Dec 2023
- 2023From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguation10 Dec 2023
- 2023Multi-Irreducible Spectral Synchronization for Robust Rotation Averaging28 Nov 2023
- 2023HDMNet: A Hierarchical Matching Network with Double Attention for Large-scale Outdoor LiDAR Point Cloud Registration29 Oct 2023
- 2023AutoSynth: Learning to Generate 3D Training Data for Object Point Cloud Registration20 Sep 2023
- 2023MV-ROPE: Multi-view Constraints for Robust Category-level Object Pose and Size Estimation17 Aug 2023
- 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFs8 Jun 2023
- 2023Dictionary Learning under Symmetries via Group Representations31 May 2023
- 2023ReSync: Riemannian Subgradient-based Robust Rotation Synchronization24 May 2023
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation22 Mar 2023
- 2022Tight Certification of Adversarially Trained Neural Networks via Nonconvex Low-Rank Semidefinite Relaxations30 Nov 2022
- 2022Sketch-and-solve approaches to k-means clustering by semidefinite programming28 Nov 2022
- 2022Snapshot of Algebraic Vision20 Oct 2022
- 2022A Deep Moving-camera Background Model16 Sep 2022
- 2022Estimation Contracts for Outlier-Robust Geometric Perception22 Aug 2022
- 2022Theseus: A Library for Differentiable Nonlinear Optimization19 Jul 2022
- 2022Unrolled algorithms for group synchronization19 Jul 2022
- 2022Towards Understanding The Semidefinite Relaxations of Truncated Least-Squares in Robust Rotation Search18 Jul 2022
- 2022Accelerating Certifiable Estimation with Preconditioned Eigensolvers12 Jul 2022
- 2022Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization5 Jul 2022
- 2022Procrustes Analysis with Deformations: A Closed-Form Solution by Eigenvalue Decomposition29 Jun 2022
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypoints24 Jun 2022
50 newest of 80 All 80 (JSON)
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 65
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 54
- 2021HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registrationcited by 48
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagationcited by 33
- 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFscited by 33
- 2021Quantum Permutation Synchronizationcited by 32
- 2021HARA: A Hierarchical Approach for Robust Rotation Averagingcited by 23
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimizationcited by 21
- 2022Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certificationcited by 21
- 2021PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Cloudscited by 20
12 most cited of 80 All 80 (JSON)
- 2026(DNN)2: Doubly Non-Negative Relaxations for Deep Neural Networks25 Aug 2026
- 2026HETA++: Global Structure-from-Motion with Hybrid Explicit Translation Averaging17 Jul 2026
- 2026TriP: A Triangle Puzzle Approach to Robust Translation Averaging8 May 2026
- 2026NS-RGS: Newton-Schulz based Riemannian gradient method for orthogonal group synchronization7 Apr 2026
- 2026Certifiable Factor Graph Optimization1 Mar 2026
- 2026QuadSync: Quadrifocal Tensor Synchronization via Tucker Decomposition26 Feb 2026
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2026Incremental Mapping with Measurement Synchronization & Compression8 Feb 2026
- 2026Dual Quaternion SE(3) Synchronization with Recovery Guarantees30 Jan 2026
- 2025Sparse Variable Projection in Robotic Perception: Exploiting Separable Structure for Efficient Nonlinear Optimization8 Dec 2025
- 2025Practical and Performant Enhancements for Maximization of Algebraic Connectivity11 Nov 2025
- 2025Learning from Frustration: Torsor CNNs on Graphs27 Oct 2025
12 newest of 80 All 80 (JSON)