Advances in Global Solvers for 3D Vision
Not on the map. Why?
Abstract (arXiv)
Global solvers have emerged as a powerful paradigm for 3D vision, offering certifiable solutions to nonconvex geometric optimization problems traditionally addressed by local or heuristic methods. This survey presents the first systematic review of global solvers in geometric vision, unifying the field through a comprehensive taxonomy of three core paradigms: Branch-and-Bound (BnB), Convex Relaxation (CR), and Graduated Non-Convexity (GNC). We present their theoretical foundations, algorithmic designs, and practical enhancements for robustness and scalability, examining how each addresses the fundamental nonconvexity of geometric estimation problems. Our analysis spans ten core vision tasks, from Wahba problem to bundle adjustment, revealing the optimality-robustness-scalability trade-offs that govern solver selection. We identify critical future directions: scaling algorithms while maintaining guarantees, integrating data-driven priors with certifiable optimization, establishing standardized benchmarks, and addressing societal implications for safety-critical deployment. By consolidating theoretical foundations, practical advances, and broader impacts, this survey provides a unified perspective and roadmap toward certifiable, trustworthy perception for real-world applications. A continuously-updated literature summary and companion code tutorials are available at https://github.com/ericzzj1989/Awesome-Global-Solvers-for-3D-Vision.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 139 of its 446 references that are in the map. First posted on arXiv 16 Feb 2026.
Builds on
139 of 446 references.
References · 139
- 2021Convex optimizationcited by 2,479
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2019Differentiable Convex Optimization Layerscited by 458
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2024Global Structure-from-Motion Revisitedcited by 215
38 more
- 2019MAGSAC++, a fast, reliable and accurate robust estimatorcited by 160
- 2016Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registrationcited by 159
- 2019Neural-Guided RANSAC: Learning Where to Sample Model Hypothesescited by 129
- 2019Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejectioncited by 92
- 2016SE-Sync: A Certifiably Correct Algorithm for Synchronization over the Special Euclidean Groupcited by 80
- 2017Guaranteed Outlier Removal for Point Cloud Registration with Correspondencescited by 62
- 2020Shonan Rotation Averaging: Global Optimality by Surfing SO(p)ncited by 46
- 2016The non-convex Burer-Monteiro approach works on smooth semidefinite programscited by 44
- 2014Robust Camera Location Estimation by Convex Programmingcited by 41
- 2019A Polynomial-time Solution for Robust Registration with Extreme Outlier Ratescited by 38
- 2017Near-optimal bounds for phase synchronizationcited by 32
- 2024OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understandingcited by 31
- 2018Star Tracking using an Event Cameracited by 30
- 2018An Overview of Robust Subspace Recoverycited by 29
- 2019A Quaternion-based Certifiably Optimal Solution to the Wahba Problem with Outlierscited by 29
- 2019Baseline Desensitizing In Translation Averagingcited by 27
- 2020Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applicationscited by 26
- 2021Self-supervised Geometric Perceptioncited by 26
- 2018Robust Fitting in Computer Vision: Easy or Hard?cited by 25
- 2023VISION Datasets: A Benchmark for Vision-based InduStrial InspectiONcited by 25
- 2018Modeling Perceptual Aliasing in SLAM via Discrete-Continuous Graphical Modelscited by 24
- 2014Tightness of the maximum likelihood semidefinite relaxation for angular synchronizationcited by 23
- 2016GOGMA: Globally-Optimal Gaussian Mixture Alignmentcited by 22
- 2020Message Passing Least Squares Framework and its Application to Rotation Synchronizationcited by 22
- 2021HARA: A Hierarchical Approach for Robust Rotation Averagingcited by 22
- 2018The Alignment of the Spheres: Globally-Optimal Spherical Mixture Alignment for Camera Pose Estimationcited by 20
- 2019A Practical Maximum Clique Algorithm for Matching with Pairwise Constraintscited by 20
- 2018Convex Relaxations for Pose Graph Optimization with Outlierscited by 19
- 2020One Ring to Rule Them All: Certifiably Robust Geometric Perception with Outlierscited by 19
- 2021Hybrid Rotation Averaging: A Fast and Robust Rotation Averaging Approachcited by 19
- 2015Lagrangian Duality in 3D SLAM: Verification Techniques and Optimal Solutionscited by 18
- 2023Revisiting Rotation Averaging: Uncertainties and Robust Lossescited by 18
- 2013Global registration of multiple point clouds using semidefinite programmingcited by 17
- 2019Distributed Certifiably Correct Pose-Graph Optimizationcited by 17
- 2015A Riemannian low-rank method for optimization over semidefinite matrices with block-diagonal constraintscited by 16
- 2016ShapeFit and ShapeKick for Robust, Scalable Structure from Motioncited by 16
- 2018Practical optimal registration of terrestrial LiDAR scan pairscited by 16
- 2019An Efficient Solution to Non-Minimal Case Essential Matrix Estimationcited by 16
50 most cited of 139 All 139 (JSON)
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026FocusTrack: One-Stage Focus-and-Suppress Framework for 3D Point Cloud Object Trackingcited by 7
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
- 2026Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learningcited by 3
- 2026DP-FedAdamW: An Efficient Optimizer for Differentially Private Federated Large Modelscited by 1
- 2026CNMBI: Determining the Number of Clusters Using Center Pairwise Matching and Boundary Filteringcited by 1
- 2026Deep Image Clustering Based on Curriculum Learning and Density Informationcited by 1
- 2026IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agentscited by 1
- 2026MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAMcited by 1
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivotingcited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verificationcited by 0
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blurcited by 0
- 2026Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstructioncited by 0
- 2026Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction1 Sep 2026
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blur27 Aug 2026
- 2026Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learning21 Jun 2026
- 2026MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM18 Jun 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting13 Jun 2026
- 2026IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agents6 Apr 2026
- 2026Deep Image Clustering Based on Curriculum Learning and Density Information31 Mar 2026
- 2026CNMBI: Determining the Number of Clusters Using Center Pairwise Matching and Boundary Filtering23 Mar 2026
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulation9 Mar 2026
- 2026FocusTrack: One-Stage Focus-and-Suppress Framework for 3D Point Cloud Object Tracking27 Feb 2026
- 2026DP-FedAdamW: An Efficient Optimizer for Differentially Private Federated Large Models23 Feb 2026