Generalized Differentiable RANSAC
Not on the map. Why?
Abstract (arXiv)
We propose nabla-RANSAC, a generalized differentiable RANSAC that allows learning the entire randomized robust estimation pipeline. The proposed approach enables the use of relaxation techniques for estimating the gradients in the sampling distribution, which are then propagated through a differentiable solver. The trainable quality function marginalizes over the scores from all the models estimated within nabla-RANSAC to guide the network learning accurate and useful inlier probabilities or to train feature detection and matching networks. Our method directly maximizes the probability of drawing a good hypothesis, allowing us to learn better sampling distributions. We test nabla-RANSAC on various real-world scenarios on fundamental and essential matrix estimation, and 3D point cloud registration, outdoors and indoors, with handcrafted and learning-based features. It is superior to the state-of-the-art in terms of accuracy while running at a similar speed to its less accurate alternatives. The code and trained models are available at https://github.com/weitong8591/differentiableransac.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 31 of its 81 references that are in the map. First posted on arXiv 26 Dec 2022.
Builds on
31 of 81 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
19 more
- 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 231
- 2022Geometric Transformer for Fast and Robust Point Cloud Registrationcited by 200
- 2017Learning to Find Good Correspondencescited by 176
- 2019MAGSAC++, a fast, reliable and accurate robust estimatorcited by 160
- 2019Learning Two-View Correspondences and Geometry Using Order-Aware Networkcited by 148
- 2020Understanding Gradient Clipping in Private SGD: A Geometric Perspectivecited by 140
- 2017Graph-Cut RANSACcited by 133
- 2019Neural-Guided RANSAC: Learning Where to Sample Model Hypothesescited by 129
- 2018MAGSAC: marginalizing sample consensuscited by 122
- 2019Stochastic Optimization of Sorting Networks via Continuous Relaxationscited by 111
- 2021Progressive Correspondence Pruning by Consensus Learningcited by 46
- 2015MODS: Fast and Robust Method for Two-View Matchingcited by 26
- 2021VSAC: Efficient and Accurate Estimator for H and Fcited by 17
- 2019Low-variance Black-box Gradient Estimates for the Plackett-Luce Distributioncited by 11
- 2020Learning Surrogates via Deep Embeddingcited by 11
- 2019ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learningcited by 9
- 2022NeFSAC: Neurally Filtered Minimal Samplescited by 9
- 2021FEDS -- Filtered Edit Distance Surrogatecited by 5
- 2016Hypergraph Modelling for Geometric Model Fittingcited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 12; 2025: 11; 2026: 4.
30 papers.
Sort:
By area:
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 60
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 50
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
- 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondencescited by 25
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motioncited by 25
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformerscited by 19
- 2025Relative Pose Estimation through Affine Corrections of Monocular Depth Priorscited by 18
- 2024Learning to Make Keypoints Sub-Pixel Accuratecited by 13
- 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimationcited by 12
- 2025DaD: Distilled Reinforcement Learning for Diverse Keypoint Detectioncited by 12
18 more
- 2025TurboReg: TurboClique for Robust and Efficient Point Cloud Registrationcited by 12
- 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioningcited by 7
- 2025Deep Learning Reforms Image Matching: A Survey and Outlookcited by 7
- 2025SupeRANSAC: One RANSAC to Rule Them Allcited by 6
- 2024Image Matching Filtering and Refinement by Planes and Beyondcited by 5
- 2024Unsupervised Point Cloud Registration with Self-Distillationcited by 4
- 2024MinBackProp -- Backpropagating through Minimal Solverscited by 1
- 2024Efficient and Distributed Large-Scale 3D Map Registration using Tomographic Featurescited by 1
- 2025Monte Carlo Diffusion for Generalizable Learning-Based RANSACcited by 1
- 2023KVN: Keypoints Voting Network with Differentiable RANSAC for Stereo Pose Estimationcited by 0
- 2024Global Point Cloud Registration Network for Large Transformationscited by 0
- 2025A Birotation Solution for Relative Pose Problemscited by 0
- 2025Event-driven Robust Fitting on Neuromorphic Hardwarecited by 0
- 2025End2Reg: Learning Task-Specific Segmentation for Markerless Registration in Spine Surgerycited by 0
- 2026Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsingcited by 0
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectivescited by 0
- 2026DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimationcited by 0
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priorscited by 0
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimation31 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing10 Jul 2026
- 2025End2Reg: Learning Task-Specific Segmentation for Markerless Registration in Spine Surgery15 Dec 2025
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformers3 Dec 2025
- 2025Event-driven Robust Fitting on Neuromorphic Hardware13 Aug 2025
- 2025TurboReg: TurboClique for Robust and Efficient Point Cloud Registration2 Jul 2025
- 2025SupeRANSAC: One RANSAC to Rule Them All5 Jun 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025A Birotation Solution for Relative Pose Problems4 May 2025
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motion28 Apr 2025
18 more
- 2025Monte Carlo Diffusion for Generalizable Learning-Based RANSAC12 Mar 2025
- 2025DaD: Distilled Reinforcement Learning for Diverse Keypoint Detection10 Mar 2025
- 2025Relative Pose Estimation through Affine Corrections of Monocular Depth Priors9 Jan 2025
- 2024Image Matching Filtering and Refinement by Planes and Beyond14 Nov 2024
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting29 Oct 2024
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motion27 Sep 2024
- 2024Unsupervised Point Cloud Registration with Self-Distillation11 Sep 2024
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimization10 Sep 2024
- 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioning22 Jul 2024
- 2024Learning to Make Keypoints Sub-Pixel Accurate16 Jul 2024
- 2024Efficient and Distributed Large-Scale 3D Map Registration using Tomographic Features27 Jun 2024
- 2024MinBackProp -- Backpropagating through Minimal Solvers27 Apr 2024
- 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences9 Apr 2024
- 2024Global Point Cloud Registration Network for Large Transformations26 Mar 2024
- 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimation5 Mar 2024
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs12 Dec 2023
- 2023Visual Geometry Grounded Deep Structure From Motion7 Dec 2023
- 2023KVN: Keypoints Voting Network with Differentiable RANSAC for Stereo Pose Estimation21 Jul 2023
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 60
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 50
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
- 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondencescited by 25
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motioncited by 25
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformerscited by 19
- 2025Relative Pose Estimation through Affine Corrections of Monocular Depth Priorscited by 18
- 2024Learning to Make Keypoints Sub-Pixel Accuratecited by 13
- 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimationcited by 12
- 2025DaD: Distilled Reinforcement Learning for Diverse Keypoint Detectioncited by 12
12 most cited of 29 All 29 (JSON)
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing10 Jul 2026
- 2025End2Reg: Learning Task-Specific Segmentation for Markerless Registration in Spine Surgery15 Dec 2025
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformers3 Dec 2025
- 2025Event-driven Robust Fitting on Neuromorphic Hardware13 Aug 2025
- 2025TurboReg: TurboClique for Robust and Efficient Point Cloud Registration2 Jul 2025
- 2025SupeRANSAC: One RANSAC to Rule Them All5 Jun 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025A Birotation Solution for Relative Pose Problems4 May 2025
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motion28 Apr 2025
- 2025Monte Carlo Diffusion for Generalizable Learning-Based RANSAC12 Mar 2025
12 newest of 29 All 29 (JSON)