mlsanityData to 7 Oct 2026

Depth Any Canopy: Leveraging Depth Foundation Models for Canopy Height Estimation

arXiv 2408.04523 ↗First posted 8 Aug 2024cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Estimating global tree canopy height is crucial for forest conservation and climate change applications. However, capturing high-resolution ground truth canopy height using LiDAR is expensive and not available globally. An efficient alternative is to train a canopy height estimator to operate on single-view remotely sensed imagery. The primary obstacle to this approach is that these methods require significant training data to generalize well globally and across uncommon edge cases. Recent monocular depth estimation foundation models have show strong zero-shot performance even for complex scenes. In this paper we leverage the representations learned by these models to transfer to the remote sensing domain for measuring canopy height. Our findings suggest that our proposed Depth Any Canopy, the result of fine-tuning the Depth Anything v2 model for canopy height estimation, provides a performant and efficient solution, surpassing the current state-of-the-art with superior or comparable performance using only a fraction of the computational resources and parameters. Furthermore, our approach requires less than 1.30 in compute and results in an estimated carbon footprint of 0.14 kgCO2. Code, experimental results, and model checkpoints are openly available at https://github.com/DarthReca/depth-any-canopy.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 8 Aug 2024.

Builds on

23 of 40 references.

References · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2023Segment Anythingcited by 8,158
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2021Vision Transformers for Dense Predictioncited by 1,789
  6. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  7. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  8. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  9. 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
  10. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  11. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
  12. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
11 more
  1. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
  2. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
  3. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
  4. 2022A high-resolution canopy height model of the Earthcited by 91
  5. 2023A Billion-scale Foundation Model for Remote Sensing Imagescited by 62
  6. 2023Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidarcited by 60
  7. 2024Segment Any Changecited by 35
  8. 2023SS-MAE: Spatial-Spectral Masked Auto-Encoder for Multi-Source Remote Sensing Image Classificationcited by 24
  9. 2024Open-Canopy: Towards Very High Resolution Forest Monitoringcited by 16
  10. 2024Estimating Canopy Height at Scalecited by 15
  11. 2021Country-wide Retrieval of Forest Structure From Optical and SAR Satellite Imagery With Deep Ensemblescited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 5.

12 papers.