RoMa: Robust Dense Feature Matching
Not on the map. Why?
Abstract (arXiv)
Feature matching is an important computer vision task that involves estimating correspondences between two images of a 3D scene, and dense methods estimate all such correspondences. The aim is to learn a robust model, i.e., a model able to match under challenging real-world changes. In this work, we propose such a model, leveraging frozen pretrained features from the foundation model DINOv2. Although these features are significantly more robust than local features trained from scratch, they are inherently coarse. We therefore combine them with specialized ConvNet fine features, creating a precisely localizable feature pyramid. To further improve robustness, we propose a tailored transformer match decoder that predicts anchor probabilities, which enables it to express multimodality. Finally, we propose an improved loss formulation through regression-by-classification with subsequent robust regression. We conduct a comprehensive set of experiments that show that our method, RoMa, achieves significant gains, setting a new state-of-the-art. In particular, we achieve a 36% improvement on the extremely challenging WxBS benchmark. Code is provided at https://github.com/Parskatt/RoMa
Key facts. Cited by 302 papers in the map (data through 14 Oct 2026). Builds on 46 of its 69 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
46 of 69 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
34 more
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 576
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2020DISK: Learning local features with policy gradientcited by 312
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2017HPatches: A benchmark and evaluation of handcrafted and learned local descriptorscited by 264
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2018Neighbourhood Consensus Networkscited by 174
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 171
- 2019MAGSAC++, a fast, reliable and accurate robust estimatorcited by 161
- 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
- 2022QuadTree Attention for Vision Transformerscited by 129
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2022Revealing the Dark Secrets of Masked Image Modelingcited by 117
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2019Hierarchical Scene Coordinate Classification and Regression for Visual Localizationcited by 93
- 2020Dual-Resolution Correspondence Networkscited by 90
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2018DGC-Net: Dense Geometric Correspondence Networkcited by 67
- 2021CamLiFlow: Bidirectional Camera-LiDAR Fusion for Joint Optical Flow and Scene Flow Estimationcited by 56
- 2023SiLK -- Simple Learned Keypointscited by 54
- 2020GOCor: Bringing Globally Optimized Correspondence Volumes into Your Neural Networkcited by 53
- 2020Wasserstein Distances for Stereo Disparity Estimationcited by 38
- 2023PATS: Patch Area Transportation with Subdivision for Local Feature Matchingcited by 33
- 2023PMatch: Paired Masked Image Modeling for Dense Geometric Matchingcited by 29
- 2022A case for using rotation invariant features in state of the art feature matcherscited by 27
- 2015WxBS: Wide Baseline Stereo Generalizationscited by 23
- 2023Adaptive Spot-Guided Transformer for Consistent Local Feature Matchingcited by 22
- 2022Proper Reuse of Image Classification Features Improves Object Detectioncited by 20
- 2021Neural Reprojection Error: Merging Feature Learning and Camera Pose Estimationcited by 17
- 2023Improving Transformer-based Image Matching by Cascaded Capturing Spatially Informative Keypointscited by 15
- 2019Large Scale Joint Semantic Re-Localisation and Scene Understanding via Globally Unique Instance Coordinate Regressioncited by 12
- 2022Could Giant Pretrained Image Models Extract Universal Representations?cited by 6
Built on by
Citing papers per year: 2023: 4; 2024: 39; 2025: 130; 2026: 129.
302 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2025Aether: Geometric-Aware Unified World Modelingcited by 97
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 82
- 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 62
- 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 54
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
38 more
- 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
- 2024SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splattingcited by 42
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 41
- 2025No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Viewscited by 40
- 2024DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detectorcited by 39
- 2024CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agentscited by 39
- 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
- 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 37
- 2025UFM: A Simple Path towards Unified Dense Correspondence with Flowcited by 36
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motioncited by 26
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformerscited by 22
- 2025C3G: Learning Compact 3D Representations with 2K Gaussianscited by 21
- 2025iLRM: An Iterative Large 3D Reconstruction Modelcited by 19
- 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Trainingcited by 18
- 2025Relative Pose Estimation through Affine Corrections of Monocular Depth Priorscited by 18
- 2025Cluster and Predict Latent Patches for Improved Masked Image Modelingcited by 17
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approachcited by 16
- 2023Segment Anything Model is a Good Teacher for Local Feature Learningcited by 15
- 2025Dense-SfM: Structure from Motion with Dense Consistent Matchingcited by 15
- 2025HAMSt3R: Human-Aware Multi-view Stereo 3D Reconstructioncited by 15
- 2025JamMa: Ultra-lightweight Local Feature Matching with Joint Mambacited by 14
- 2025Co-op: Correspondence-based Novel Object Pose Estimationcited by 14
- 2025From Sparse to Dense: Camera Relocalization with Scene-Specific Detector from Feature Gaussian Splattingcited by 14
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
- 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translationcited by 14
- 2024LoD-Loc: Aerial Visual Localization using LoD 3D Map with Neural Wireframe Alignmentcited by 13
- 2025DaD: Distilled Reinforcement Learning for Diverse Keypoint Detectioncited by 13
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
- 2025RDD: Robust Feature Detector and Descriptor using Deformable Transformercited by 13
- 2025MATCHA:Towards Matching Anythingcited by 12
- 2025CoMatch: Dynamic Covisibility-Aware Transformer for Bilateral Subpixel-Level Semi-Dense Image Matchingcited by 12
- 2025OrthoLoC: UAV 6-DoF Localization and Calibration Using Orthographic Geodatacited by 12
- 2025Rig3R: Rig-Aware Conditioning for Learned 3D Reconstructioncited by 11
- 2026LoMa: Local Feature Matching Revisitedcited by 11
- 2023TopicFM+: Boosting Accuracy and Efficiency of Topic-Assisted Feature Matchingcited by 10
- 2025RePoseD: Efficient Relative Pose Estimation With Known Depth Informationcited by 10
50 most cited of 302 All 302 (JSON)
- 2026OLiVES: An Outdoor Low-Light Video Benchmark for Enhancement and Segmentation14 Oct 2026
- 2026Observation Quality in DSM-Assisted Aerial Localization: A Benchmark and Base-Anchored Uncertainty Calibration13 Oct 2026
- 2026Towards Complementary Keypoint Detection via Mixture of Detectors12 Oct 2026
- 2026Across Viewpoints and Time: Trajectory-Generalizable Physical Attacks on World Models and Video Understanding Models11 Oct 2026
- 2026ScalLoc: Continuous Oblique Thermal UAV Geo-Localization with a 2D Satellite Map10 Oct 2026
- 2026TartanMatch: Towards Universal Dense Correspondence Across Modalities10 Oct 2026
- 2026Geometry-Aligned Semantic Matching for Cross-Modal Planar Image Registration2 Oct 2026
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026MVDG: Efficient Multi-view 3D Disambiguation on Unconstrained Real-World Images1 Oct 2026
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026Emergent Multi-View Geometry Through Self-Distillation30 Sep 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
38 more
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026SCCM: Spherically Consistent Coarse Matching for ERP Dense Feature Correspondence29 Sep 2026
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026From Feed-Forward to Flow: Unifying Reconstruction and Generation Is Easier Than You Think26 Sep 2026
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation26 Sep 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026Evaluating Transformation Models for pCLE Mosaic Registration21 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations11 Sep 2026
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026MemCorr-DP: Counterfactual Correspondence Conditioning for a Diffusion Policy Guided by a Reference6 Sep 2026
- 2026Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching6 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space31 Aug 2026
- 2026FoundYou: A Unified Model for Personalized Segmentation and Retrieval30 Aug 2026
- 2026Pixel-wise Geo-registration of Drone and Satellite Images28 Aug 2026
- 2026Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging28 Aug 2026
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blur27 Aug 2026
- 2026DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models24 Aug 2026
- 2026Misanthrope: A Privacy-Preserving Keypoint Detector24 Aug 2026
- 2026Self-Calibrating Dense Displacement Fields for Reliable Co-Registration of Large Optical Satellite Imagery23 Aug 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026Evaluation of Image Matching Methods for Visual Odometry on UAVs19 Aug 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026XFeat Revisited: Reproducibility and Evaluation of a Lightweight Image Matcher10 Aug 2026
- 2026LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matching4 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
- 2026Accuracy potential of visual localization exploiting high-end street-level imagery27 Jul 2026
- 2026MuViSeg: Multi-View Segment Correspondences from Dense Geometry Priors20 Jul 2026
- 2026Point Tracking in Surgery--The 2025 Surgical Tattoos in Infrared Challenge (STIRC2025)14 Jul 2026
- 2026DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motion10 Jul 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026Hybrid Deep Learning for Traceability and Classification of Industrial Slate Tiles6 Jul 2026
- 2026OmniDS: Dual-Stream Context Fusion for Omnidirectional Depth from Fisheye Cameras3 Jul 2026
50 newest of 302 All 302 (JSON)
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approachcited by 16
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
- 2025MEAT: Multiview Diffusion Model for Human Generation on Megapixels with Mesh Attentioncited by 8
- 2026World Reconstruction From Inconsistent Viewscited by 8
- 2025Geometric Consistency Refinement for Single Image Novel View Synthesis via Test-Time Adaptation of Diffusion Modelscited by 2
- 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policiescited by 2
- 2026HomoFM: Deep Homography Estimation with Flow Matchingcited by 1
- 2026MaSC: A Masked Similarity Metric for Evaluating Concept-Driven Generationcited by 0
- 2026MemCorr-DP: Counterfactual Correspondence Conditioning for a Diffusion Policy Guided by a Referencecited by 0
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimationcited by 0
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation26 Sep 2026
- 2026MemCorr-DP: Counterfactual Correspondence Conditioning for a Diffusion Policy Guided by a Reference6 Sep 2026
- 2026MaSC: A Masked Similarity Metric for Evaluating Concept-Driven Generation21 May 2026
- 2026World Reconstruction From Inconsistent Views17 Mar 2026
- 2026HomoFM: Deep Homography Estimation with Flow Matching26 Jan 2026
- 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policies2 Nov 2025
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion8 May 2025
- 2025Geometric Consistency Refinement for Single Image Novel View Synthesis via Test-Time Adaptation of Diffusion Models11 Apr 2025
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformer11 Apr 2025
- 2025MEAT: Multiview Diffusion Model for Human Generation on Megapixels with Mesh Attention11 Mar 2025
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approach27 Jun 2024
- 2025Aether: Geometric-Aware Unified World Modelingcited by 97
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 4
- 2026From Feed-Forward to Flow: Unifying Reconstruction and Generation Is Easier Than You Thinkcited by 0
- 2026Across Viewpoints and Time: Trajectory-Generalizable Physical Attacks on World Models and Video Understanding Modelscited by 0
- 2026Across Viewpoints and Time: Trajectory-Generalizable Physical Attacks on World Models and Video Understanding Models11 Oct 2026
- 2026From Feed-Forward to Flow: Unifying Reconstruction and Generation Is Easier Than You Think26 Sep 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2025Aether: Geometric-Aware Unified World Modeling24 Mar 2025
- 2025Observer-Actor: Active Vision Imitation Learning with Sparse-View Gaussian Splatting22 Nov 2025
- 2025One-Shot Dual-Arm Imitation Learning10 Mar 2025
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 82
- 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 62
- 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 54
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
- 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
- 2024SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splattingcited by 42
12 most cited of 273 All 273 (JSON)
- 2026OLiVES: An Outdoor Low-Light Video Benchmark for Enhancement and Segmentation14 Oct 2026
- 2026Observation Quality in DSM-Assisted Aerial Localization: A Benchmark and Base-Anchored Uncertainty Calibration13 Oct 2026
- 2026Towards Complementary Keypoint Detection via Mixture of Detectors12 Oct 2026
- 2026ScalLoc: Continuous Oblique Thermal UAV Geo-Localization with a 2D Satellite Map10 Oct 2026
- 2026TartanMatch: Towards Universal Dense Correspondence Across Modalities10 Oct 2026
- 2026Geometry-Aligned Semantic Matching for Cross-Modal Planar Image Registration2 Oct 2026
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026MVDG: Efficient Multi-view 3D Disambiguation on Unconstrained Real-World Images1 Oct 2026
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026SCCM: Spherically Consistent Coarse Matching for ERP Dense Feature Correspondence29 Sep 2026
12 newest of 273 All 273 (JSON)