Dens3R: A Foundation Model for 3D Geometry Prediction
Not on the map. Why?
Abstract (arXiv)
Recent advances in dense 3D reconstruction have led to significant progress, yet achieving accurate unified geometric prediction remains a major challenge. Most existing methods are limited to predicting a single geometry quantity from input images. However, geometric quantities such as depth, surface normals, and point maps are inherently correlated, and estimating them in isolation often fails to ensure consistency, thereby limiting both accuracy and practical applicability. This motivates us to explore a unified framework that explicitly models the structural coupling among different geometric properties to enable joint regression. In this paper, we present Dens3R, a 3D foundation model designed for joint geometric dense prediction and adaptable to a wide range of downstream tasks. Dens3R adopts a two-stage training framework to progressively build a pointmap representation that is both generalizable and intrinsically invariant. Specifically, we design a lightweight shared encoder-decoder backbone and introduce position-interpolated rotary positional encoding to maintain expressive power while enhancing robustness to high-resolution inputs. By integrating image-pair matching features with intrinsic invariance modeling, Dens3R accurately regresses multiple geometric quantities such as surface normals and depth, achieving consistent geometry perception from single-view to multi-view inputs. Additionally, we propose a post-processing pipeline that supports geometrically consistent multi-view inference. Extensive experiments demonstrate the superior performance of Dens3R across various dense 3D prediction tasks and highlight its potential for broader applications.
Key facts. Cited by 46 papers in the map (data through 14 Oct 2026). Builds on 69 of its 93 references that are in the map. First posted on arXiv 22 Jul 2025.
Builds on
69 of 93 references.
References · 69
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
38 more
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2016Playing for Data: Ground Truth from Computer Gamescited by 818
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 341
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 166
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 154
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
- 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 131
- 2020Patch2Pix: Epipolar-Guided Pixel-Level Correspondencescited by 129
- 20193D Ken Burns Effect from a Single Imagecited by 128
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2025: 11; 2026: 35.
46 papers.
Sort:
By area:
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 31
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
- 2026VGGT-Omegacited by 26
- 2025From Editor to Dense Geometry Estimatorcited by 24
- 2025MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Expertscited by 21
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 20
- 2025FlashVGGT: Efficient and Scalable Visual Geometry Transformers with Compressed Descriptor Attentioncited by 17
- 2026Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Predictioncited by 11
- 2026LoMa: Local Feature Matching Revisitedcited by 11
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesiscited by 8
34 more
- 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformercited by 8
- 2025MVInverse: Feed-forward Multi-view Inverse Rendering in Secondscited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026D'ej`a View: Looping Transformers for Multi-View 3D Reconstructioncited by 6
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2026TrajVG: 3D Trajectory-Coupled Visual Geometry Learningcited by 4
- 2026Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Modelscited by 4
- 2026Large Depth Completion Model from Sparse Observationscited by 4
- 2025Mem4D: Decoupling Static and Dynamic Memory for Dynamic Scene Reconstructioncited by 3
- 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generationcited by 3
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimationcited by 3
- 2026GGPT: Geometry Grounded Point Transformercited by 3
- 2026HD-VGGT: High-Resolution Visual Geometry Transformercited by 3
- 2026Towards Consistent Video Geometry Estimationcited by 3
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometrycited by 3
- 2026R3DP: Real-Time 3D-Aware Policy for Embodied Manipulationcited by 2
- 2026SurGe: Improved Surface Geometry in Point Mapscited by 2
- 2026MoWorld: A Flash World Modelcited by 2
- 2026VIAFormer: Voxel-Image Alignment Transformer for High-Fidelity Voxel Refinementcited by 1
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstructioncited by 1
- 20262K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Predictioncited by 1
- 2026IVGT: Implicit Visual Geometry Transformer for Neural Scene Representationcited by 1
- 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformerscited by 1
- 2026NoDrift3R: Raymap-Guided Coupling for Drift-Robust Unposed Feed-Forward 3D Reconstructioncited by 1
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generationcited by 0
- 20264DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimationcited by 0
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformerscited by 0
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matchingcited by 0
- 2026Walking in the Implicit: Interactive World Exploration via Neural Scene Representationcited by 0
- 2026GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priorscited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunitiescited by 0
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimationcited by 0
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backendcited by 0
- 2026CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstructioncited by 0
- 2026CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstruction9 Oct 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation6 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors15 Jul 2026
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry13 Jul 2026
- 2026NoDrift3R: Raymap-Guided Coupling for Drift-Robust Unposed Feed-Forward 3D Reconstruction8 Jul 2026
- 2026MoWorld: A Flash World Model7 Jul 2026
- 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers3 Jul 2026
- 2026Walking in the Implicit: Interactive World Exploration via Neural Scene Representation29 Jun 2026
- 2026SurGe: Improved Surface Geometry in Point Maps29 May 2026
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
34 more
- 2026D'ej`a View: Looping Transformers for Multi-View 3D Reconstruction28 May 2026
- 2026Large Depth Completion Model from Sparse Observations28 May 2026
- 2026Towards Consistent Video Geometry Estimation28 May 2026
- 2026Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Models23 May 2026
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers22 May 2026
- 2026IVGT: Implicit Visual Geometry Transformer for Neural Scene Representation15 May 2026
- 2026VGGT-Omega14 May 2026
- 20264DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimation12 May 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026LoMa: Local Feature Matching Revisited6 Apr 2026
- 2026HD-VGGT: High-Resolution Visual Geometry Transformer28 Mar 2026
- 20262K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Prediction20 Mar 2026
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstruction20 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026R3DP: Real-Time 3D-Aware Policy for Embodied Manipulation15 Mar 2026
- 2026GGPT: Geometry Grounded Point Transformer11 Mar 2026
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer5 Mar 2026
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimation4 Mar 2026
- 2026Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Prediction25 Feb 2026
- 2026TrajVG: 3D Trajectory-Coupled Visual Geometry Learning4 Feb 2026
- 2026VIAFormer: Voxel-Image Alignment Transformer for High-Fidelity Voxel Refinement20 Jan 2026
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generation15 Jan 2026
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstruction7 Jan 2026
- 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformer24 Dec 2025
- 2025MVInverse: Feed-forward Multi-view Inverse Rendering in Seconds24 Dec 2025
- 2025FlashVGGT: Efficient and Scalable Visual Geometry Transformers with Compressed Descriptor Attention1 Dec 2025
- 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generation28 Nov 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstruction25 Nov 2025
- 2025MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Experts31 Oct 2025
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting12 Oct 2025
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesis29 Sep 2025
- 2025From Editor to Dense Geometry Estimator4 Sep 2025
- 2025Mem4D: Decoupling Static and Dynamic Memory for Dynamic Scene Reconstruction11 Aug 2025
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 31
- 2025From Editor to Dense Geometry Estimatorcited by 24
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generationcited by 0
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matchingcited by 0
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimationcited by 0
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation6 Sep 2026
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generation15 Jan 2026
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstruction7 Jan 2026
- 2025From Editor to Dense Geometry Estimator4 Sep 2025
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
- 2026VGGT-Omegacited by 26
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 20
- 2025FlashVGGT: Efficient and Scalable Visual Geometry Transformers with Compressed Descriptor Attentioncited by 17
- 2026Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Predictioncited by 11
- 2026LoMa: Local Feature Matching Revisitedcited by 11
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesiscited by 8
- 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformercited by 8
- 2025MVInverse: Feed-forward Multi-view Inverse Rendering in Secondscited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
12 most cited of 37 All 37 (JSON)
- 2026CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstruction9 Oct 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors15 Jul 2026
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry13 Jul 2026
- 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers3 Jul 2026
- 2026Walking in the Implicit: Interactive World Exploration via Neural Scene Representation29 Jun 2026
- 2026SurGe: Improved Surface Geometry in Point Maps29 May 2026
- 2026D'ej`a View: Looping Transformers for Multi-View 3D Reconstruction28 May 2026
- 2026Large Depth Completion Model from Sparse Observations28 May 2026
- 2026Towards Consistent Video Geometry Estimation28 May 2026
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers22 May 2026
12 newest of 37 All 37 (JSON)