mlsanityData to 14 Oct 2026

Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation

arXiv 2511.22429 ↗First posted 27 Nov 2025cs.CVcited by 6

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

We present Fin3R, a simple, effective, and general fine-tuning method for feed-forward 3D reconstruction models. The family of feed-forward reconstruction model regresses pointmap of all input images to a reference frame coordinate system, along with other auxiliary outputs, in a single forward pass. However, we find that current models struggle with fine geometry and robustness due to (textiti) the scarcity of high-fidelity depth and pose supervision and (textitii) the inherent geometric misalignment from multi-view pointmap regression. Fin3R jointly tackles two issues with an extra lightweight fine-tuning step. We freeze the decoder, which handles view matching, and fine-tune only the image encoder-the component dedicated to feature extraction. The encoder is enriched with fine geometric details distilled from a strong monocular teacher model on large, unlabeled datasets, using a custom, lightweight LoRA adapter. We validate our method on a wide range of models, including DUSt3R, MASt3R, CUT3R, and VGGT. The fine-tuned models consistently deliver sharper boundaries, recover complex structures, and achieve higher geometric accuracy in both single- and multi-view settings, while adding only the tiny LoRA weights, which leave test-time memory and latency virtually unchanged. Project page: hrefhttp://visual-ai.github.io/fin3rhttps://visual-ai.github.io/fin3r

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 67 of its 86 references that are in the map. First posted on arXiv 27 Nov 2025.

Builds on

67 of 86 references.

References · 67

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023Segment Anythingcited by 8,234
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  7. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  8. 2024Depth Anything V2cited by 1,422
  9. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  10. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  11. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  12. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
38 more
  1. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  2. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
  3. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  4. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  5. 2023LightGlue: Local Feature Matching at Light Speedcited by 590
  6. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  7. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  8. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  9. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  10. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  11. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
  12. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  13. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  14. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  15. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  16. 2017Sparsity Invariant CNNscited by 326
  17. 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
  18. 2021Neural RGB-D Surface Reconstructioncited by 313
  19. 2016LIFT: Learned Invariant Feature Transformcited by 306
  20. 2023RoMa: Robust Dense Feature Matchingcited by 302
  21. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  22. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
  23. 20243D Reconstruction with Spatial Memorycited by 277
  24. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
  25. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
  26. 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
  27. 2020Consistent Video Depth Estimationcited by 220
  28. 2024Global Structure-from-Motion Revisitedcited by 218
  29. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
  30. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
  31. 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
  32. 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
  33. 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
  34. 2017A Survey of Structure from Motioncited by 158
  35. 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
  36. 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
  37. 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
  38. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Speed3R: Sparse Feed-forward 3D Reconstruction Models
  2. 2026CAM3R: Camera-Agnostic Model for 3D Reconstruction
  3. 2024Multi-View 3D Reconstruction using Knowledge Distillation
  4. 2026PAGER: Partial-to-global Alignment via Geometric and Relational Distillation
  5. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images
  6. 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend
  7. 2025Can Video Diffusion Model Reconstruct 4D Geometry?
  8. 2026PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling