Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
We present Fin3R, a simple, effective, and general fine-tuning method for feed-forward 3D reconstruction models. The family of feed-forward reconstruction model regresses pointmap of all input images to a reference frame coordinate system, along with other auxiliary outputs, in a single forward pass. However, we find that current models struggle with fine geometry and robustness due to (textiti) the scarcity of high-fidelity depth and pose supervision and (textitii) the inherent geometric misalignment from multi-view pointmap regression. Fin3R jointly tackles two issues with an extra lightweight fine-tuning step. We freeze the decoder, which handles view matching, and fine-tune only the image encoder-the component dedicated to feature extraction. The encoder is enriched with fine geometric details distilled from a strong monocular teacher model on large, unlabeled datasets, using a custom, lightweight LoRA adapter. We validate our method on a wide range of models, including DUSt3R, MASt3R, CUT3R, and VGGT. The fine-tuned models consistently deliver sharper boundaries, recover complex structures, and achieve higher geometric accuracy in both single- and multi-view settings, while adding only the tiny LoRA weights, which leave test-time memory and latency virtually unchanged. Project page: hrefhttp://visual-ai.github.io/fin3rhttps://visual-ai.github.io/fin3r
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 67 of its 86 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
67 of 86 references.
References · 67
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2024Depth Anything V2cited by 1,422
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
38 more
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2017Sparsity Invariant CNNscited by 326
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2016LIFT: Learned Invariant Feature Transformcited by 306
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 20243D Reconstruction with Spatial Memorycited by 277
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2020Consistent Video Depth Estimationcited by 220
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
- 2017A Survey of Structure from Motioncited by 158
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026Fus3D: Decoding Consolidated 3D Geometry from Feed-forward Geometry Transformer Latentscited by 0
- 2026First Shape, Then Meaning: Efficient Geometry and Semantics Learning for Indoor Reconstructioncited by 0
- 2026Geometry beneath the Waves: Dense Priors for Sparse-View Underwater 3D Gaussian Splattingcited by 0
- 2026GRF-Recon: Global Ray-Field Optimization for Long-Sequence Feed-forward Reconstructioncited by 0
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Computecited by 0
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026GRF-Recon: Global Ray-Field Optimization for Long-Sequence Feed-forward Reconstruction17 Sep 2026
- 2026Geometry beneath the Waves: Dense Priors for Sparse-View Underwater 3D Gaussian Splatting16 Sep 2026
- 2026First Shape, Then Meaning: Efficient Geometry and Semantics Learning for Indoor Reconstruction5 May 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026Fus3D: Decoding Consolidated 3D Geometry from Feed-forward Geometry Transformer Latents26 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Speed3R: Sparse Feed-forward 3D Reconstruction Models
- 2026CAM3R: Camera-Agnostic Model for 3D Reconstruction
- 2024Multi-View 3D Reconstruction using Knowledge Distillation
- 2026PAGER: Partial-to-global Alignment via Geometric and Relational Distillation
- 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend
- 2025Can Video Diffusion Model Reconstruct 4D Geometry?
- 2026PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling