RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching
Not on the map. Why?
Abstract (arXiv)
Learned image matching has experienced significant progress in recent years, culminating in robust and accurate matchers such as RoMa, whose robustness is often attributed to its use of frozen DINO features. In a parallel development, feed-forward reconstruction models, such as VGGT, have been trained on ever-growing datasets to accurately regress dense 3D point maps and camera poses. The distinction between matchers and feed-forward reconstruction models has become increasingly blurred with the introduction of matching losses in models such as MASt3R and VGGT-Omega. This raises a natural question: what do feed-forward 3D models know about image matching? In this work, we answer this question by analyzing three scenarios: (i) zero-shot matching of patch features, (ii) direct matching of 3D point predictions, and (iii) training a full matcher on top of the learned representations. We find that, despite performing poorly in zero-shot matching, especially in later layers, feed-forward reconstruction models provide strong representations for linear probing and full matching pipelines. We further show that, even without any training, their raw predictions alone enable competitive matching, albeit only under moderate viewpoint changes and modality gaps. Based on these insights, we retrain RoMa v2 by replacing its DINO backbone with VGGT-Omega. Our resulting model, ours, outperforms state-of-the-art matchers on a wide range of benchmarks, e.g. +8.1 mAA compared to RoMa v2 on WxBS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 74 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
59 of 74 references.
References · 59
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2025DINOv3cited by 1,414
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
38 more
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2020Virtual KITTI 2cited by 353
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 341
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2020DISK: Learning local features with policy gradientcited by 312
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2017HPatches: A benchmark and evaluation of handcrafted and learned local descriptorscited by 264
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 121
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
- 2019Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filterscited by 118
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 114
- 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 96
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2023DeDoDe: Detect, Don't Describe -- Describe, Don't Detect for Local Feature Matchingcited by 63
- 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
- 2017Repeatability Is Not Enough: Learning Affine Regions via Discriminabilitycited by 57
- 2014TILDE: A Temporally Invariant Learned DEtectorcited by 55
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2024DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detectorcited by 39
- 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
- 2025UFM: A Simple Path towards Unified Dense Correspondence with Flowcited by 36
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
- 2015WxBS: Wide Baseline Stereo Generalizationscited by 23
- 2023Steerers: A framework for rotation equivariant keypoint descriptorscited by 21
- 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.