Depth Any Canopy: Leveraging Depth Foundation Models for Canopy Height Estimation
Not on the map. Why?
Abstract (arXiv)
Estimating global tree canopy height is crucial for forest conservation and climate change applications. However, capturing high-resolution ground truth canopy height using LiDAR is expensive and not available globally. An efficient alternative is to train a canopy height estimator to operate on single-view remotely sensed imagery. The primary obstacle to this approach is that these methods require significant training data to generalize well globally and across uncommon edge cases. Recent monocular depth estimation foundation models have show strong zero-shot performance even for complex scenes. In this paper we leverage the representations learned by these models to transfer to the remote sensing domain for measuring canopy height. Our findings suggest that our proposed Depth Any Canopy, the result of fine-tuning the Depth Anything v2 model for canopy height estimation, provides a performant and efficient solution, surpassing the current state-of-the-art with superior or comparable performance using only a fraction of the computational resources and parameters. Furthermore, our approach requires less than 1.30 in compute and results in an estimated carbon footprint of 0.14 kgCO2. Code, experimental results, and model checkpoints are openly available at https://github.com/DarthReca/depth-any-canopy.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 8 Aug 2024.
Builds on
23 of 40 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
11 more
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2022A high-resolution canopy height model of the Earthcited by 91
- 2023A Billion-scale Foundation Model for Remote Sensing Imagescited by 62
- 2023Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidarcited by 60
- 2024Segment Any Changecited by 35
- 2023SS-MAE: Spatial-Spectral Masked Auto-Encoder for Multi-Source Remote Sensing Image Classificationcited by 24
- 2024Open-Canopy: Towards Very High Resolution Forest Monitoringcited by 16
- 2024Estimating Canopy Height at Scalecited by 15
- 2021Country-wide Retrieval of Forest Structure From Optical and SAR Satellite Imagery With Deep Ensemblescited by 9
Built on by
Citing papers per year: 2024: 1; 2025: 6; 2026: 5.
12 papers.
- 2025Enhancing Monocular Height Estimation via Sparse LiDAR-Guided Correctioncited by 4
- 2025Zero-Shot Tree Detection and Segmentation from Aerial Forest Imagerycited by 3
- 2026Are Pretrained Image Matchers Good Enough for SAR-Optical Satellite Registration?cited by 2
- 2025MCTED: A Machine-Learning-Ready Dataset for Digital Elevation Model Generation From Mars Imagerycited by 1
- 2024SinkSAM-Net: Knowledge-Driven Self-Supervised Sinkhole Segmentation Using Topographic Priors and Segment Anything Modelcited by 0
- 2025Deep Self-Supervised Disturbance Mapping with the OPERA Sentinel-1 Radiometric Terrain Corrected SAR Backscatter Productcited by 0
- 2025Seamless High-Resolution Terrain Reconstruction: A Prior-Based Vision Transformer Approachcited by 0
- 2025Top2Ground: A Height-Aware Dual Conditioning Diffusion Model for Robust Aerial-to-Ground View Generationcited by 0
- 2026FSKD: Monocular Forest Structure Inference via LiDAR-to-RGBI Knowledge Distillationcited by 0
- 2026Test-Time Adaptation for Height Completion via Self-Supervised ViT Features and Monocular Foundation Modelscited by 0
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0
- 2026Rapid Debris-Volume Estimation from Post-Hurricane Aerial Imagerycited by 0
- 2026Rapid Debris-Volume Estimation from Post-Hurricane Aerial Imagery17 Aug 2026
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery9 May 2026
- 2026Are Pretrained Image Matchers Good Enough for SAR-Optical Satellite Registration?11 Apr 2026
- 2026Test-Time Adaptation for Height Completion via Self-Supervised ViT Features and Monocular Foundation Models2 Apr 2026
- 2026FSKD: Monocular Forest Structure Inference via LiDAR-to-RGBI Knowledge Distillation2 Apr 2026
- 2025Top2Ground: A Height-Aware Dual Conditioning Diffusion Model for Robust Aerial-to-Ground View Generation11 Nov 2025
- 2025MCTED: A Machine-Learning-Ready Dataset for Digital Elevation Model Generation From Mars Imagery9 Sep 2025
- 2025Seamless High-Resolution Terrain Reconstruction: A Prior-Based Vision Transformer Approach13 Jul 2025
- 2025Zero-Shot Tree Detection and Segmentation from Aerial Forest Imagery3 Jun 2025
- 2025Enhancing Monocular Height Estimation via Sparse LiDAR-Guided Correction11 May 2025
- 2025Deep Self-Supervised Disturbance Mapping with the OPERA Sentinel-1 Radiometric Terrain Corrected SAR Backscatter Product15 Jan 2025
- 2024SinkSAM-Net: Knowledge-Driven Self-Supervised Sinkhole Segmentation Using Topographic Priors and Segment Anything Model2 Oct 2024