HD-VGGT: High-Resolution Visual Geometry Transformer
Not on the map. Why?
Abstract (arXiv)
High-resolution imagery is essential for accurate 3D reconstruction, as many geometric details only emerge at fine spatial scales. Recent feed-forward approaches, such as the Visual Geometry Grounded Transformer (VGGT), have demonstrated the ability to infer scene geometry from large collections of images in a single forward pass. However, scaling these models to high-resolution inputs remains challenging: the number of tokens in transformer architectures grows rapidly with both image resolution and the number of views, leading to prohibitive computational and memory costs. Moreover, we observe that visually ambiguous regions, such as repetitive patterns, weak textures, or specular surfaces, often produce unstable feature tokens that degrade geometric inference, especially at higher resolutions. We introduce HD-VGGT, a dual-branch architecture for efficient and robust high-resolution 3D reconstruction. A low-resolution branch predicts a coarse, globally consistent geometry, while a high-resolution branch refines details via a learned feature upsampling module. To handle unstable tokens, we propose Feature Modulation, which suppresses unreliable features early in the transformer. HD-VGGT leverages high-resolution images and supervision without full-resolution transformer costs, achieving state-of-the-art reconstruction quality.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 28 Mar 2026.
Builds on
41 of 68 references.
References · 41
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2020Efficient Transformers: A Surveycited by 784
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
29 more
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 20243D Reconstruction with Spatial Memorycited by 269
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformercited by 93
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 60
- 2021Learning Statistical Texture for Semantic Segmentationcited by 50
- 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 44
- 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 34
- 2025AnyUp: Universal Feature Upsamplingcited by 26
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 26
- 2023Ultra-High Resolution Segmentation with Ultra-Rich Context: A Novel Benchmarkcited by 22
- 2025POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentationcited by 22
- 2020Context-Aware Graph Convolution Network for Target Re-identificationcited by 21
- 2023Guided Patch-Grouping Wavelet Transformer with Spatial Congruence for Ultra-High Resolution Segmentationcited by 16
- 2024Discrete Latent Perspective Learning for Segmentation and Detectioncited by 16
- 2024View-Centric Multi-Object Tracking with Homographic Matching in Moving UAVcited by 10
- 2024PPTFormer: Pseudo Multi-Perspective Transformer for UAV Segmentationcited by 10
- 2025Structural and Statistical Texture Knowledge Distillation and Learning for Segmentationcited by 9
- 2018Scene Coordinate and Correspondence Learning for Image-Based Localizationcited by 7
- 2025Not Every Patch is Needed: Towards a More Efficient and Effective Backbone for Video-based Person Re-identificationcited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026VGGT-Omegacited by 20
- 2026MoWorld: A Flash World Modelcited by 2
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstructioncited by 0
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstruction8 Oct 2026
- 2026MoWorld: A Flash World Model7 Jul 2026
- 2026VGGT-Omega14 May 2026