mlsanityData to 7 Oct 2026

Any Resolution Any Geometry: From Multi-View To Multi-Patch

arXiv 2603.03026 ↗First posted 3 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Joint estimation of surface normals and depth is essential for holistic 3D scene understanding, yet high-resolution prediction remains difficult due to the trade-off between preserving fine local detail and maintaining global consistency. To address this challenge, we propose the Ultra Resolution Geometry Transformer (URGT), which adapts the Visual Geometry Grounded Transformer (VGGT) into a unified multi-patch transformer for monocular high-resolution depth--normal estimation. A single high-resolution image is partitioned into patches that are augmented with coarse depth and normal priors from pre-trained models, and jointly processed in a single forward pass to predict refined geometric outputs. Global coherence is enforced through cross-patch attention, which enables long-range geometric reasoning and seamless propagation of information across patches within a shared backbone. To further enhance spatial robustness, we introduce a GridMix patch sampling strategy that probabilistically samples grid configurations during training, improving inter-patch consistency and generalization. Our method achieves state-of-the-art results on UnrealStereo4K, jointly improving depth and normal estimation, reducing AbsRel from 0.0582 to 0.0291, RMSE from 2.17 to 1.31, and lowering mean angular error from 23.36 degrees to 18.51 degrees, while producing sharper and more stable geometry. The proposed multi-patch framework also demonstrates strong zero-shot and cross-domain generalization and scales effectively to very high resolutions, offering an efficient and extensible solution for high-quality geometry refinement.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

21 of 27 references.

References · 21

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2021Vision Transformers for Dense Predictioncited by 1,789
  3. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  4. 2024Depth Anything V2cited by 1,385
  5. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  6. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  7. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  8. 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 159
  9. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
  10. 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
  11. 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
  12. 2020SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detectioncited by 66
9 more
  1. 2022Open Challenges in Deep Stereo: the Booster Datasetcited by 48
  2. 2023PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimationcited by 39
  3. 2020GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimationcited by 36
  4. 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillationcited by 21
  5. 2024PatchRefiner: Leveraging Synthetic Data for Real-Domain High-Resolution Monocular Metric Depth Estimationcited by 15
  6. 2022Multi-resolution Monocular Depth Map Fusion by Self-supervised Gradient-based Compositioncited by 8
  7. 2024Self-Distilled Depth Refinement with Noisy Poisson Fusioncited by 4
  8. 2025PatchRefiner V2: Fast and Lightweight Real-Domain High-Resolution Metric Depth Estimationcited by 3
  9. 2025One Look is Enough: Seamless Patchwise Refinement for Zero-Shot Monocular Depth Estimation on High-Resolution Imagescited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation
  2. 2025OmniVGGT: Omni-Modality Driven Visual Geometry Grounded Transformer
  3. 2026PrePARE: Pre-AA Token Pruning for Frozen Multi-View Geometry Transformers
  4. 2026GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normal
  5. 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
  6. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  7. 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible
  8. 2026D3-RSMDE: 40× Faster and High-Fidelity Remote Sensing Monocular Depth Estimation