mlsanityData to 14 Oct 2026

RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching

arXiv 2609.09507 ↗First posted 8 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Learned image matching has experienced significant progress in recent years, culminating in robust and accurate matchers such as RoMa, whose robustness is often attributed to its use of frozen DINO features. In a parallel development, feed-forward reconstruction models, such as VGGT, have been trained on ever-growing datasets to accurately regress dense 3D point maps and camera poses. The distinction between matchers and feed-forward reconstruction models has become increasingly blurred with the introduction of matching losses in models such as MASt3R and VGGT-Omega. This raises a natural question: what do feed-forward 3D models know about image matching? In this work, we answer this question by analyzing three scenarios: (i) zero-shot matching of patch features, (ii) direct matching of 3D point predictions, and (iii) training a full matcher on top of the learned representations. We find that, despite performing poorly in zero-shot matching, especially in later layers, feed-forward reconstruction models provide strong representations for linear probing and full matching pipelines. We further show that, even without any training, their raw predictions alone enable competitive matching, albeit only under moderate viewpoint changes and modality gaps. Based on these insights, we retrain RoMa v2 by replacing its DINO backbone with VGGT-Omega. Our resulting model, ours, outperforms state-of-the-art matchers on a wide range of benchmarks, e.g. +8.1 mAA compared to RoMa v2 on WxBS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 74 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

59 of 74 references.

References · 59

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  5. 2021Vision Transformers for Dense Predictioncited by 1,803
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  7. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  8. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  9. 2025DINOv3cited by 1,414
  10. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
  11. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  12. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
38 more
  1. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  2. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  3. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  4. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  5. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  6. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  7. 2023LightGlue: Local Feature Matching at Light Speedcited by 590
  8. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
  9. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  10. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  11. 2020Virtual KITTI 2cited by 353
  12. 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 341
  13. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  14. 2020DISK: Learning local features with policy gradientcited by 312
  15. 2023RoMa: Robust Dense Feature Matchingcited by 302
  16. 2017HPatches: A benchmark and evaluation of handcrafted and learned local descriptorscited by 264
  17. 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
  18. 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
  19. 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 121
  20. 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
  21. 2019Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filterscited by 118
  22. 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 114
  23. 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 96
  24. 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
  25. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  26. 2023DeDoDe: Detect, Don't Describe -- Describe, Don't Detect for Local Feature Matchingcited by 63
  27. 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
  28. 2017Repeatability Is Not Enough: Learning Affine Regions via Discriminabilitycited by 57
  29. 2014TILDE: A Temporally Invariant Learned DEtectorcited by 55
  30. 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
  31. 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
  32. 2024DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detectorcited by 39
  33. 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
  34. 2025UFM: A Simple Path towards Unified Dense Correspondence with Flowcited by 36
  35. 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
  36. 2015WxBS: Wide Baseline Stereo Generalizationscited by 23
  37. 2023Steerers: A framework for rotation equivariant keypoint descriptorscited by 21
  38. 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.