One Ring to Rule Them All: Certifiably Robust Geometric Perception with Outliers
Not on the map. Why?
Abstract (arXiv)
We propose the first general and practical framework to design certifiable algorithms for robust geometric perception in the presence of a large amount of outliers. We investigate the use of a truncated least squares (TLS) cost function, which is known to be robust to outliers, but leads to hard, nonconvex, and nonsmooth optimization problems. Our first contribution is to show that -for a broad class of geometric perception problems- TLS estimation can be reformulated as an optimization over the ring of polynomials and Lasserre's hierarchy of convex moment relaxations is empirically tight at the minimum relaxation order (i.e., certifiably obtains the global minimum of the nonconvex TLS problem). Our second contribution is to exploit the structural sparsity of the objective and constraint polynomials and leverage basis reduction to significantly reduce the size of the semidefinite program (SDP) resulting from the moment relaxation, without compromising its tightness. Our third contribution is to develop scalable dual optimality certifiers from the lens of sums-of-squares (SOS) relaxation, that can compute the suboptimality gap and possibly certify global optimality of any candidate solution (e.g., returned by fast heuristics such as RANSAC or graduated non-convexity). Our dual certifiers leverage Douglas-Rachford Splitting to solve a convex feasibility SDP. Numerical experiments across different perception problems, including single rotation averaging, shape alignment, 3D point cloud and mesh registration, and high-integrity satellite pose estimation, demonstrate the tightness of our relaxations, the correctness of the certification, and the scalability of the proposed dual certifiers to large problems, beyond the reach of current SDP solvers.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 5; 2023: 1; 2024: 1; 2025: 2; 2026: 1.
19 papers.
Sort:
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Self-supervised Geometric Perceptioncited by 26
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimizationcited by 21
- 2021Advances in Inference and Representation for Simultaneous Localization and Mappingcited by 16
- 2021Optimal Pose and Shape Estimation for Category-level 3D Object Perceptioncited by 15
- 2022ARCS: Accurate Rotation and Correspondence Searchcited by 15
- 2021Rotation Coordinate Descent for Fast Globally Optimal Rotation Averagingcited by 14
- 2021Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systemscited by 12
- 2026Advances in Global Solvers for 3D Visioncited by 12
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2021An Inexact Projected Gradient Method with Rounding and Lifting by Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of Polynomial Optimizationcited by 10
- 2021Dynamical Pose Estimationcited by 6
7 more
- 2022Monitoring of Perception Systems: Deterministic, Probabilistic, and Learning-based Fault Detection and Identificationcited by 6
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypointscited by 6
- 2023Robust Single Rotation Averaging Revisitedcited by 6
- 2024An Overview of the Burer-Monteiro Method for Certifiable Robot Perceptioncited by 5
- 2025Fast globally optimal Truncated Least Squares point cloud registration with fixed rotation axiscited by 2
- 2022Sparse Polynomial Optimization: Theory and Practicecited by 0
- 2025GNC-Pose: Geometry-Aware GNC-PnP for Accurate 6D Pose Estimationcited by 0
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2025GNC-Pose: Geometry-Aware GNC-PnP for Accurate 6D Pose Estimation6 Dec 2025
- 2025Fast globally optimal Truncated Least Squares point cloud registration with fixed rotation axis21 Aug 2025
- 2024An Overview of the Burer-Monteiro Method for Certifiable Robot Perception30 Sep 2024
- 2023Robust Single Rotation Averaging Revisited11 Sep 2023
- 2022Sparse Polynomial Optimization: Theory and Practice23 Aug 2022
- 2022Estimation Contracts for Outlier-Robust Geometric Perception22 Aug 2022
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypoints24 Jun 2022
- 2022Monitoring of Perception Systems: Deterministic, Probabilistic, and Learning-based Fault Detection and Identification22 May 2022
- 2022ARCS: Accurate Rotation and Correspondence Search28 Mar 2022
- 2021Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systems25 Sep 2021
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimization7 Sep 2021
7 more
- 2021An Inexact Projected Gradient Method with Rounding and Lifting by Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of Polynomial Optimization28 May 2021
- 2021Optimal Pose and Shape Estimation for Category-level 3D Object Perception16 Apr 2021
- 2021Rotation Coordinate Descent for Fast Globally Optimal Rotation Averaging15 Mar 2021
- 2021Dynamical Pose Estimation10 Mar 2021
- 2021Advances in Inference and Representation for Simultaneous Localization and Mapping8 Mar 2021
- 2021Self-supervised Geometric Perception4 Mar 2021
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Survey2 Jan 2021
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Self-supervised Geometric Perceptioncited by 26
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimizationcited by 21
- 2021Advances in Inference and Representation for Simultaneous Localization and Mappingcited by 16
- 2021Optimal Pose and Shape Estimation for Category-level 3D Object Perceptioncited by 15
- 2022ARCS: Accurate Rotation and Correspondence Searchcited by 15
- 2021Rotation Coordinate Descent for Fast Globally Optimal Rotation Averagingcited by 14
- 2021Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systemscited by 12
- 2026Advances in Global Solvers for 3D Visioncited by 12
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2021An Inexact Projected Gradient Method with Rounding and Lifting by Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of Polynomial Optimizationcited by 10
- 2021Dynamical Pose Estimationcited by 6
12 most cited of 19 All 19 (JSON)
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2025GNC-Pose: Geometry-Aware GNC-PnP for Accurate 6D Pose Estimation6 Dec 2025
- 2025Fast globally optimal Truncated Least Squares point cloud registration with fixed rotation axis21 Aug 2025
- 2024An Overview of the Burer-Monteiro Method for Certifiable Robot Perception30 Sep 2024
- 2023Robust Single Rotation Averaging Revisited11 Sep 2023
- 2022Sparse Polynomial Optimization: Theory and Practice23 Aug 2022
- 2022Estimation Contracts for Outlier-Robust Geometric Perception22 Aug 2022
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypoints24 Jun 2022
- 2022Monitoring of Perception Systems: Deterministic, Probabilistic, and Learning-based Fault Detection and Identification22 May 2022
- 2022ARCS: Accurate Rotation and Correspondence Search28 Mar 2022
- 2021Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systems25 Sep 2021
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimization7 Sep 2021
12 newest of 19 All 19 (JSON)