Test-Time Adaptation for Height Completion via Self-Supervised ViT Features and Monocular Foundation Models
Not on the map. Why?
Abstract (arXiv)
Accurate digital surface models (DSMs) are essential for many geospatial applications, including urban monitoring, environmental analyses, infrastructure management, and change detection. However, large-scale DSMs frequently contain incomplete or outdated regions due to acquisition limitations, reconstruction artifacts, or changes in the built environment. Traditional height completion approaches primarily rely on spatial interpolation or which assume spatial continuity and therefore fail when objects are missing. Recent learning-based approaches improve reconstruction quality but typically require supervised training on sensor-specific datasets, limiting their generalization across domains and sensing conditions. We propose Prior2DSM, a training-free framework for metric DSM completion that operates entirely at test time by leveraging foundation models. Unlike previous height completion approaches that require task-specific training, the proposed method combines self-supervised Vision Transformer (ViT) features from DINOv3 with monocular depth foundation models to propagate metric information from incomplete height priors through semantic feature-space correspondence. Test-time adaptation (TTA) is performed using parameter-efficient low-rank adaptation (LoRA) together with a lightweight multilayer perceptron (MLP), which predicts spatially varying scale and shift parameters to convert relative depth estimates into metric heights. Experiments demonstrate consistent improvements over interpolation based methods, prior-based rescaling height approaches, and state-of-the-art monocular depth estimation models. Prior2DSM reduces reconstruction error while preserving structural fidelity, achieving up to a 46% reduction in RMSE compared to linear fitting of MDE, and further enables DSM updating and coupled RGB-DSM generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
29 of 49 references.
References · 29
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
- 2024Bilateral Propagation Network for Depth Completioncited by 59
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2025Depth Anything with Any Priorcited by 32
17 more
- 2018IM2HEIGHT: Height Estimation from Single Monocular Imagery via Fully Residual Convolutional-Deconvolutional Networkcited by 31
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 17
- 2025GlobalBuildingAtlas: An Open Global and Complete Dataset of Building Polygons, Heights and LoD1 3D Modelscited by 16
- 2024Depth Any Canopy: Leveraging Depth Foundation Models for Canopy Height Estimationcited by 12
- 2022Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depthcited by 11
- 2024SynRS3D: A Synthetic Dataset for Global 3D Semantic Understanding from Monocular Remote Sensing Imagerycited by 9
- 2018Void Filling of Digital Elevation Models with Deep Generative Modelscited by 7
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Priorcited by 6
- 2025Enhancing Monocular Height Estimation via Sparse LiDAR-Guided Correctioncited by 4
- 2026Depth Completion as Parameter-Efficient Test-Time Adaptationcited by 3
- 2026StreamTTO: Efficient Online Test-Time Optimization for Video Depth Completioncited by 3
- 2025Monocular One-Shot Metric-Depth Alignment for RGB-Based Robot Graspingcited by 2
- 2025Propagating Sparse Depth via Depth Foundation Model for Out-of-Distribution Depth Completioncited by 2
- 2026Reconstructing Building Height from Spaceborne TomoSAR Point Clouds Using a Dual-Topology Networkcited by 2
- 2025A Novel Solution for Drone Photogrammetry with Low-overlap Aerial Images using Monocular Depth Estimationcited by 1
- 2025Enhancing Generalization of Depth Estimation Foundation Model via Weakly-Supervised Adaptation with Regularizationcited by 1
Built on by
Not cited yet.