VFM-Recon: Unlocking Cross-Domain Scene-Level Neural Reconstruction with Scale-Aligned Foundation Priors
Not on the map. Why?
Abstract (arXiv)
Scene-level neural volumetric reconstruction from monocular videos remains challenging, especially under severe domain shifts. Although recent advances in vision foundation models (VFMs) provide transferable generalized priors learned from large-scale data, their scaleambiguous predictions are incompatible with the scale consistency required by volumetric fusion. To address this gap, we present VFMRecon, the first attempt to bridge transferable VFM priors with scaleconsistent requirements in scene-level neural reconstruction. Specifically, we first introduce a lightweight scale alignment stage that restores multiview scale coherence. We then integrate pretrained VFM features into the neural volumetric reconstruction pipeline via lightweight task-specific adapters, which are trained for reconstruction while preserving the crossdomain robustness of pretrained representations. We train our model on ScanNet train split and evaluate on both in-distribution ScanNet test split and out-of-distribution TUM RGB-D and Tanks and Temples datasets. The results demonstrate that our model achieves state-of-theart performance across all datasets domains. In particular, on the challenging outdoor Tanks and Temples dataset, our model achieves an F1 score of 70.1 in reconstructed mesh evaluation, substantially outperforming the closest competitor, VGGT, which only attains 51.8.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
45 of 58 references.
References · 45
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
33 more
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 107
- 2022SimpleRecon: 3D Reconstruction Without 3D Convolutionscited by 83
- 2020DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusioncited by 68
- 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
- 2021VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusioncited by 38
- 2024GeoLRM: Geometry-Aware Large Reconstruction Model for High-Quality 3D Gaussian Generationcited by 35
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2024DepthCues: Evaluating Monocular Depth Perception in Large Vision Modelscited by 18
- 2022FD-SLAM: 3-D Reconstruction Using Features and Dense Matchingcited by 17
- 2023FineRecon: Depth-aware Feed-forward Network for Detailed 3D Reconstructioncited by 16
- 2023CVRecon: Rethinking 3D Geometric Feature Learning For Neural Reconstructioncited by 16
- 2024AirPlanes: Accurate Plane Estimation via 3D-Consistent Embeddingscited by 13
- 2024DoubleTake: Geometry Guided Depth Estimationcited by 9
- 2023SSR-2D: Semantic 3D Scene Reconstruction from 2D Imagescited by 7
- 2023Incremental Dense Reconstruction from Monocular Video with Guided Sparse Feature Volume Fusioncited by 6
- 2023PlaneRecTR++: Unified Query Learning for Joint 3D Planar Reconstruction and Pose Estimationcited by 6
- 2025Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstructioncited by 5
- 2024EPRecon: An Efficient Framework for Real-Time Panoptic 3D Reconstruction from Monocular Videocited by 4
- 2025Evaluating Foundation Models' 3D Understanding Through Multi-View Correspondence Analysiscited by 1
Built on by
Not cited yet.