mlsanityData to 7 Oct 2026

HD-VGGT: High-Resolution Visual Geometry Transformer

arXiv 2603.27222 ↗First posted 28 Mar 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

High-resolution imagery is essential for accurate 3D reconstruction, as many geometric details only emerge at fine spatial scales. Recent feed-forward approaches, such as the Visual Geometry Grounded Transformer (VGGT), have demonstrated the ability to infer scene geometry from large collections of images in a single forward pass. However, scaling these models to high-resolution inputs remains challenging: the number of tokens in transformer architectures grows rapidly with both image resolution and the number of views, leading to prohibitive computational and memory costs. Moreover, we observe that visually ambiguous regions, such as repetitive patterns, weak textures, or specular surfaces, often produce unstable feature tokens that degrade geometric inference, especially at higher resolutions. We introduce HD-VGGT, a dual-branch architecture for efficient and robust high-resolution 3D reconstruction. A low-resolution branch predicts a coarse, globally consistent geometry, while a high-resolution branch refines details via a learned feature upsampling module. To handle unstable tokens, we propose Feature Modulation, which suppresses unreliable features early in the transformer. HD-VGGT leverages high-resolution images and supervision without full-resolution transformer costs, achieving state-of-the-art reconstruction quality.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

41 of 68 references.

References · 41

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  4. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  7. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  8. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  9. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  10. 2020Efficient Transformers: A Surveycited by 784
  11. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
29 more
  1. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  2. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  3. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  4. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  5. 2021Neural RGB-D Surface Reconstructioncited by 312
  6. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  7. 20243D Reconstruction with Spatial Memorycited by 269
  8. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  9. 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
  10. 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
  11. 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
  12. 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformercited by 93
  13. 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 60
  14. 2021Learning Statistical Texture for Semantic Segmentationcited by 50
  15. 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
  16. 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 44
  17. 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 34
  18. 2025AnyUp: Universal Feature Upsamplingcited by 26
  19. 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 26
  20. 2023Ultra-High Resolution Segmentation with Ultra-Rich Context: A Novel Benchmarkcited by 22
  21. 2025POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentationcited by 22
  22. 2020Context-Aware Graph Convolution Network for Target Re-identificationcited by 21
  23. 2023Guided Patch-Grouping Wavelet Transformer with Spatial Congruence for Ultra-High Resolution Segmentationcited by 16
  24. 2024Discrete Latent Perspective Learning for Segmentation and Detectioncited by 16
  25. 2024View-Centric Multi-Object Tracking with Homographic Matching in Moving UAVcited by 10
  26. 2024PPTFormer: Pseudo Multi-Perspective Transformer for UAV Segmentationcited by 10
  27. 2025Structural and Statistical Texture Knowledge Distillation and Learning for Segmentationcited by 9
  28. 2018Scene Coordinate and Correspondence Learning for Image-Based Localizationcited by 7
  29. 2025Not Every Patch is Needed: Towards a More Efficient and Effective Backbone for Video-based Person Re-identificationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.