mlsanityData to 14 Oct 2026

Dens3R: A Foundation Model for 3D Geometry Prediction

arXiv 2507.16290 ↗First posted 22 Jul 2025cs.CVcited by 46

Not on the map. Why?

Abstract (arXiv)

Recent advances in dense 3D reconstruction have led to significant progress, yet achieving accurate unified geometric prediction remains a major challenge. Most existing methods are limited to predicting a single geometry quantity from input images. However, geometric quantities such as depth, surface normals, and point maps are inherently correlated, and estimating them in isolation often fails to ensure consistency, thereby limiting both accuracy and practical applicability. This motivates us to explore a unified framework that explicitly models the structural coupling among different geometric properties to enable joint regression. In this paper, we present Dens3R, a 3D foundation model designed for joint geometric dense prediction and adaptable to a wide range of downstream tasks. Dens3R adopts a two-stage training framework to progressively build a pointmap representation that is both generalizable and intrinsically invariant. Specifically, we design a lightweight shared encoder-decoder backbone and introduce position-interpolated rotary positional encoding to maintain expressive power while enhancing robustness to high-resolution inputs. By integrating image-pair matching features with intrinsic invariance modeling, Dens3R accurately regresses multiple geometric quantities such as surface normals and depth, achieving consistent geometry perception from single-view to multi-view inputs. Additionally, we propose a post-processing pipeline that supports geometrically consistent multi-view inference. Extensive experiments demonstrate the superior performance of Dens3R across various dense 3D prediction tasks and highlight its potential for broader applications.

Key facts. Cited by 46 papers in the map (data through 14 Oct 2026). Builds on 69 of its 93 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

69 of 93 references.

References · 69

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  4. 2021Vision Transformers for Dense Predictioncited by 1,803
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  7. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  8. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  10. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  11. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  12. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
38 more
  1. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  2. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  3. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  4. 2016Playing for Data: Ground Truth from Computer Gamescited by 818
  5. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  6. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  7. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  8. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
  9. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  10. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  11. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  12. 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
  13. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  14. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  15. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  16. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  17. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  18. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  19. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  20. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  21. 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 341
  22. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  23. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
  24. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  25. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
  26. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
  27. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
  28. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
  29. 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
  30. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  31. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 166
  32. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 154
  33. 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
  34. 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
  35. 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 131
  36. 2020Patch2Pix: Epipolar-Guided Pixel-Level Correspondencescited by 129
  37. 20193D Ken Burns Effect from a Single Imagecited by 128
  38. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 11; 2026: 35.

46 papers.

Sort:

By area:

  1. 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
  2. 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 31
  3. 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
  4. 2026VGGT-Omegacited by 26
  5. 2025From Editor to Dense Geometry Estimatorcited by 24
  6. 2025MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Expertscited by 21
  7. 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 20
  8. 2025FlashVGGT: Efficient and Scalable Visual Geometry Transformers with Compressed Descriptor Attentioncited by 17
  9. 2026Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Predictioncited by 11
  10. 2026LoMa: Local Feature Matching Revisitedcited by 11
  11. 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
  12. 2025VGGT-X: When VGGT Meets Dense Novel View Synthesiscited by 8
34 more
  1. 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformercited by 8
  2. 2025MVInverse: Feed-forward Multi-view Inverse Rendering in Secondscited by 6
  3. 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
  4. 2026D'ej`a View: Looping Transformers for Multi-View 3D Reconstructioncited by 6
  5. 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
  6. 2026TrajVG: 3D Trajectory-Coupled Visual Geometry Learningcited by 4
  7. 2026Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Modelscited by 4
  8. 2026Large Depth Completion Model from Sparse Observationscited by 4
  9. 2025Mem4D: Decoupling Static and Dynamic Memory for Dynamic Scene Reconstructioncited by 3
  10. 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generationcited by 3
  11. 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimationcited by 3
  12. 2026GGPT: Geometry Grounded Point Transformercited by 3
  13. 2026HD-VGGT: High-Resolution Visual Geometry Transformercited by 3
  14. 2026Towards Consistent Video Geometry Estimationcited by 3
  15. 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometrycited by 3
  16. 2026R3DP: Real-Time 3D-Aware Policy for Embodied Manipulationcited by 2
  17. 2026SurGe: Improved Surface Geometry in Point Mapscited by 2
  18. 2026MoWorld: A Flash World Modelcited by 2
  19. 2026VIAFormer: Voxel-Image Alignment Transformer for High-Fidelity Voxel Refinementcited by 1
  20. 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstructioncited by 1
  21. 20262K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Predictioncited by 1
  22. 2026IVGT: Implicit Visual Geometry Transformer for Neural Scene Representationcited by 1
  23. 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformerscited by 1
  24. 2026NoDrift3R: Raymap-Guided Coupling for Drift-Robust Unposed Feed-Forward 3D Reconstructioncited by 1
  25. 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generationcited by 0
  26. 20264DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimationcited by 0
  27. 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformerscited by 0
  28. 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matchingcited by 0
  29. 2026Walking in the Implicit: Interactive World Exploration via Neural Scene Representationcited by 0
  30. 2026GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priorscited by 0
  31. 2026Monocular Depth Estimation from a Single Image: Progress and Opportunitiescited by 0
  32. 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimationcited by 0
  33. 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backendcited by 0
  34. 2026CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstructioncited by 0