mlsanityData to 7 Oct 2026

2K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Prediction

arXiv 2603.19964 ↗First posted 20 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

High-resolution geometric prediction is essential for robust perception in autonomous driving, robotics, and AR/MR, but current foundation models are fundamentally limited by their scalability to real-world, high-resolution scenarios. Direct inference on 2K images with these models incurs prohibitive computational and memory demands, making practical deployment challenging. To tackle the issue, we present 2K Retrofit, a novel framework that enables efficient 2K-resolution inference for any geometric foundation model, without modifying or retraining the backbone. Our approach leverages fast coarse predictions and an entropy-based sparse refinement to selectively enhance high-uncertainty regions, achieving precise and high-fidelity 2K outputs with minimal overhead. Extensive experiments on widely used benchmark demonstrate that 2K Retrofit consistently achieves state-of-the-art accuracy and speed, bridging the gap between research advances and scalable deployment in high-resolution 3D vision applications. Code will be released upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 76 of its 91 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

76 of 91 references.

References · 76

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2021Vision Transformers for Dense Predictioncited by 1,789
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  7. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  9. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  10. 2024Depth Anything V2cited by 1,385
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  12. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
38 more
  1. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  2. 2022Token Merging: Your ViT But Fastercited by 995
  3. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  4. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
  5. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
  6. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  7. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  8. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  9. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  10. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  11. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  12. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  13. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  14. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  15. 2019PointRend: Image Segmentation as Renderingcited by 439
  16. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
  17. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  18. 2022Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizationscited by 359
  19. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  20. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
  21. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  22. 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
  23. 2023Token Merging for Fast Stable Diffusioncited by 220
  24. 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
  25. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 211
  26. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
  27. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  28. 2025Streaming 4D Visual Geometry Transformercited by 147
  29. 2021IA-RED2: Interpretability-Aware Redundancy Reduction for Vision Transformerscited by 127
  30. 2022ConvMAE: Masked Convolution Meets Masked Autoencoderscited by 105
  31. 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
  32. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
  33. 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
  34. 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
  35. 2022TorchSparse: Efficient Point Cloud Inference Enginecited by 72
  36. 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
  37. 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
  38. 2024Bilateral Propagation Network for Depth Completioncited by 59

50 most cited of 76 All 76 (JSON)

Built on by

Not cited yet.