Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejection
Not on the map. Why?
Abstract (arXiv)
Semidefinite Programming (SDP) and Sums-of-Squares (SOS) relaxations have led to certifiably optimal non-minimal solvers for several robotics and computer vision problems. However, most non-minimal solvers rely on least-squares formulations, and, as a result, are brittle against outliers. While a standard approach to regain robustness against outliers is to use robust cost functions, the latter typically introduce other non-convexities, preventing the use of existing non-minimal solvers. In this paper, we enable the simultaneous use of non-minimal solvers and robust estimation by providing a general-purpose approach for robust global estimation, which can be applied to any problem where a non-minimal solver is available for the outlier-free case. To this end, we leverage the Black-Rangarajan duality between robust estimation and outlier processes (which has been traditionally applied to early vision problems), and show that graduated non-convexity (GNC) can be used in conjunction with non-minimal solvers to compute robust solutions, without requiring an initial guess. Although GNC's global optimality cannot be guaranteed, we demonstrate the empirical robustness of the resulting robust non-minimal solvers in applications, including point cloud and mesh registration, pose graph optimization, and image-based object pose estimation (also called shape alignment). Our solvers are robust to 70-80% of outliers, outperform RANSAC, are more accurate than specialized local solvers, and faster than specialized global solvers. We also propose the first certifiably optimal non-minimal solver for shape alignment using SOS relaxation.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 12; 2023: 12; 2024: 16; 2025: 14; 2026: 15.
92 papers.
Sort:
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 53
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagationcited by 33
- 2021MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Squarecited by 27
- 2021Self-supervised Geometric Perceptioncited by 26
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimizationcited by 21
- 2023Swarm-SLAM : Sparse Decentralized Collaborative Simultaneous Localization and Mapping Framework for Multi-Robot Systemscited by 21
- 2022A Single Correspondence Is Enough: Robust Global Registration to Avoid Degeneracy in Urban Environmentscited by 19
- 2021Advances in Inference and Representation for Simultaneous Localization and Mappingcited by 16
- 2021RANSIC: Fast and Highly Robust Estimation for Rotation Search and Point Cloud Registration using Invariant Compatibilitycited by 16
- 2024FastMAC: Stochastic Spectral Sampling of Correspondence Graphcited by 16
38 more
- 2024Scalable 3D Registration via Truncated Entry-wise Absolute Residualscited by 16
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisitedcited by 16
- 2021Optimal Pose and Shape Estimation for Category-level 3D Object Perceptioncited by 15
- 2022ARCS: Accurate Rotation and Correspondence Searchcited by 15
- 2021Rotation Coordinate Descent for Fast Globally Optimal Rotation Averagingcited by 14
- 2021Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systemscited by 12
- 2026Advances in Global Solvers for 3D Visioncited by 12
- 2021TriVoC: Efficient Voting-based Consensus Maximization for Robust Point Cloud Registration with Extreme Outlier Ratioscited by 11
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2023G3Reg: Pyramid Graph-based Global Registration using Gaussian Ellipsoid Modelcited by 11
- 2021Efficient Reachability Analysis of Closed-Loop Systems with Neural Network Controllerscited by 10
- 2021An Inexact Projected Gradient Method with Rounding and Lifting by Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of Polynomial Optimizationcited by 10
- 2025BUFFER-X: Towards Zero-Shot Point Cloud Registration in Diverse Scenescited by 8
- 2025SG-Reg: Generalizable and Efficient Scene Graph Registrationcited by 8
- 2023Point Cloud Registration for LiDAR and Photogrammetric Data: a Critical Synthesis and Performance Analysis on Classic and Deep Learning Algorithmscited by 7
- 2024Multi-Model 3D Registration: Finding Multiple Moving Objects in Cluttered Point Cloudscited by 7
- 2024RANSAC Back to SOTA: A Two-stage Consensus Filtering for Real-time 3D Registrationcited by 7
- 2021Dynamical Pose Estimationcited by 6
- 2021Robust Event Detection based on Spatio-Temporal Latent Action Unit using Skeletal Informationcited by 6
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypointscited by 6
- 2022Optimization for Amortized Inverse Problemscited by 6
- 2023A Correct-and-Certify Approach to Self-Supervise Object Pose Estimators via Ensemble Self-Trainingcited by 6
- 2023Pyramid Semantic Graph-based Global Point Cloud Registration with Low Overlapcited by 6
- 2023Robust Single Rotation Averaging Revisitedcited by 6
- 2025GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM Systemcited by 6
- 2021Fast and Robust Certifiable Estimation of the Relative Pose Between Two Calibrated Camerascited by 5
- 2021DANIEL: A Fast and Robust Consensus Maximization Method for Point Cloud Registration with High Outlier Ratioscited by 5
- 2022Self-Supervised Domain Calibration and Uncertainty Estimation for Place Recognitioncited by 5
- 2024CLIPPER+: A Fast Maximal Clique Algorithm for Robust Global Registrationcited by 5
- 2023PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignmentcited by 4
- 2023From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguationcited by 4
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelinescited by 4
- 2021IRON: Invariant-based Highly Robust Point Cloud Registrationcited by 3
- 2021Scale-aware direct monocular odometrycited by 3
- 2021Practical, Fast and Robust Point Cloud Registration for 3D Scene Stitching and Object Localizationcited by 3
- 2022Discrete-Continuous Smoothing and Mappingcited by 3
- 2024CLIPPER: Robust Data Association without an Initial Guesscited by 3
- 2024FracGM: A Fast Fractional Programming Technique for Geman-McClure Robust Estimatorcited by 3
50 most cited of 92 All 92 (JSON)
- 2026BatSLAM 2.0: Sequence-Verified Sonar Place Recognition in a Robust Pose Graph30 Sep 2026
- 2026PARTE: Plane-Assisted Robust Transformation Estimation for Point Cloud Registration21 Sep 2026
- 2026Support Discovery With Iteratively Reweighted Least Squares for Fixed-Charge Network Flow8 Sep 2026
- 2026Triangulation-Free Bundle Adjustment with Graduated Non-Convexity for Camera Pose Refinement from Coarse Priors21 Aug 2026
- 2026Variational Outlier-Robust Gaussian Process Regression with Generative Modeling17 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
- 2026DTIF: Robust Loop Closure Detection via Delaunay Triangle Topology in Complex Forests23 Jul 2026
- 2026Robust 3D Alignment of Generative Reconstructions via Partial Monocular Observations1 Jul 2026
- 2026Point Cloud Registration via Probabilistic Self-Update Local Correspondence and Line Vector Sets29 Apr 2026
- 2026Non-Minimal Sampling and Consensus for Prohibitively Large Datasets24 Apr 2026
- 2026Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamics23 Apr 2026
- 2026DC-Reg: Globally Optimal Point Cloud Registration via Tight Bounding with Difference of Convex Programming26 Mar 2026
38 more
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2026Neural Predictor-Corrector: Solving Homotopy Problems with Reinforcement Learning3 Feb 2026
- 2026Towards Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setups6 Jan 2026
- 2025GNC-Pose: Geometry-Aware GNC-PnP for Accurate 6D Pose Estimation6 Dec 2025
- 2025CSMapping: Scalable Crowdsourced Semantic Mapping and Topology Inference for Autonomous Driving3 Dec 2025
- 2025Q3R: Quadratic Reweighted Rank Regularizer for Effective Low-Rank Training6 Nov 2025
- 2025Equi-RO: A 4D mmWave Radar Odometry via Equivariant Networks25 Sep 2025
- 2025Category-Level Object Shape and Pose Estimation in Less Than a Millisecond23 Sep 2025
- 2025GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM System21 Aug 2025
- 2025Fast globally optimal Truncated Least Squares point cloud registration with fixed rotation axis21 Aug 2025
- 2025ROVER: Robust Loop Closure Verification with Trajectory Prior in Repetitive Environments19 Aug 2025
- 2025Correspondence-Free Fast and Robust Spherical Point Pattern Registration4 Aug 2025
- 2025Multiview Point Cloud Registration via Optimization in an Autoencoder Latent Space30 Apr 2025
- 2025SG-Reg: Generalizable and Efficient Scene Graph Registration20 Apr 2025
- 2025BUFFER-X: Towards Zero-Shot Point Cloud Registration in Diverse Scenes11 Mar 2025
- 2025SANDRO: a Robust Solver with a Splitting Strategy for Point Cloud Registration10 Mar 2025
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines4 Mar 2025
- 2024QuadricsReg: Large-Scale Point Cloud Registration using Quadric Primitives4 Dec 2024
- 2024Deep Loss Convexification for Learning Iterative Models16 Nov 2024
- 2024RANSAC Back to SOTA: A Two-stage Consensus Filtering for Real-time 3D Registration21 Oct 2024
- 2024DynaVINS++: Robust Visual-Inertial State Estimator in Dynamic Environments by Adaptive Truncated Least Squares and Stable State Recovery20 Oct 2024
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisited23 Sep 2024
- 2024FracGM: A Fast Fractional Programming Technique for Geman-McClure Robust Estimator21 Sep 2024
- 2024RaNDT SLAM: Radar SLAM Based on Intensity-Augmented Normal Distributions Transform21 Aug 2024
- 2024Correspondence Free Multivector Cloud Registration using Conformal Geometric Algebra17 Jun 2024
- 2024Outlier-Robust Long-Term Robotic Mapping Leveraging Ground Segmentation18 May 2024
- 2024Decomposed Global Optimization for Robust Point Matching with Low-Dimensional Branching14 May 2024
- 2024Scalable 3D Registration via Truncated Entry-wise Absolute Residuals1 Apr 2024
- 2024FastMAC: Stochastic Spectral Sampling of Correspondence Graph13 Mar 2024
- 2024PCR-99: A Practical Method for Point Cloud Registration with 99 Percent Outliers26 Feb 2024
- 2024CLIPPER+: A Fast Maximal Clique Algorithm for Robust Global Registration23 Feb 2024
- 2024Multi-Model 3D Registration: Finding Multiple Moving Objects in Cluttered Point Clouds16 Feb 2024
- 2024CLIPPER: Robust Data Association without an Initial Guess11 Feb 2024
- 2023From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguation10 Dec 2023
- 2023Multi-Irreducible Spectral Synchronization for Robust Rotation Averaging28 Nov 2023
- 2023Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization15 Nov 2023
- 2023Robust Single Rotation Averaging Revisited11 Sep 2023
- 2023G3Reg: Pyramid Graph-based Global Registration using Gaussian Ellipsoid Model22 Aug 2023
50 newest of 92 All 92 (JSON)
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 53
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagationcited by 33
- 2021MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Squarecited by 27
- 2021Self-supervised Geometric Perceptioncited by 26
- 2021Certifiably Optimal Outlier-Robust Geometric Perception: Semidefinite Relaxations and Scalable Global Optimizationcited by 21
- 2023Swarm-SLAM : Sparse Decentralized Collaborative Simultaneous Localization and Mapping Framework for Multi-Robot Systemscited by 21
- 2022A Single Correspondence Is Enough: Robust Global Registration to Avoid Degeneracy in Urban Environmentscited by 19
- 2021Advances in Inference and Representation for Simultaneous Localization and Mappingcited by 16
- 2021RANSIC: Fast and Highly Robust Estimation for Rotation Search and Point Cloud Registration using Invariant Compatibilitycited by 16
- 2024FastMAC: Stochastic Spectral Sampling of Correspondence Graphcited by 16
12 most cited of 92 All 92 (JSON)
- 2026BatSLAM 2.0: Sequence-Verified Sonar Place Recognition in a Robust Pose Graph30 Sep 2026
- 2026PARTE: Plane-Assisted Robust Transformation Estimation for Point Cloud Registration21 Sep 2026
- 2026Support Discovery With Iteratively Reweighted Least Squares for Fixed-Charge Network Flow8 Sep 2026
- 2026Triangulation-Free Bundle Adjustment with Graduated Non-Convexity for Camera Pose Refinement from Coarse Priors21 Aug 2026
- 2026Variational Outlier-Robust Gaussian Process Regression with Generative Modeling17 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
- 2026DTIF: Robust Loop Closure Detection via Delaunay Triangle Topology in Complex Forests23 Jul 2026
- 2026Robust 3D Alignment of Generative Reconstructions via Partial Monocular Observations1 Jul 2026
- 2026Point Cloud Registration via Probabilistic Self-Update Local Correspondence and Line Vector Sets29 Apr 2026
- 2026Non-Minimal Sampling and Consensus for Prohibitively Large Datasets24 Apr 2026
- 2026Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamics23 Apr 2026
- 2026DC-Reg: Globally Optimal Point Cloud Registration via Tight Bounding with Difference of Convex Programming26 Mar 2026
12 newest of 92 All 92 (JSON)