mlsanityData to 7 Oct 2026

FSKD: Monocular Forest Structure Inference via LiDAR-to-RGBI Knowledge Distillation

arXiv 2604.01766 ↗First posted 2 Apr 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Very High Resolution (VHR) forest structure data at individual-tree scale is essential for carbon, biodiversity, and ecosystem monitoring. Still, airborne LiDAR remains costly and infrequent despite being the reference for forest structure metrics like Canopy Height Model (CHM), Plant Area Index (PAI), and Foliage Height Diversity (FHD). We propose FSKD: a LiDAR-to-RGB-Infrared (RGBI) knowledge distillation (KD) framework in which a multi-modal teacher fuses RGBI imagery with LiDAR-derived planar metrics and vertical profiles via cross-attention, and an RGBI-only SegFormer student learns to reproduce these outputs. Trained on 384 km2 of forests in Saxony, Germany (20 cm ground sampling distance (GSD)) and evaluated on eight geographically distinct test tiles, the student achieves state-of-the-art (SOTA) zero-shot CHM performance (MedAE 4.17 m, R2=0.51, IoU 0.87), outperforming HRCHM/DAC baselines by 29--46% in MAE (5.81 m vs. 8.14--10.84 m) with stronger correlation coefficients (0.713 vs. 0.166--0.652). Ablations show that multi-modal fusion improves performance by 10--26% over RGBI-only training, and that asymmetric distillation with appropriate model capacity is critical. The method jointly predicts CHM, PAI, and FHD, a multi-metric capability not provided by current monocular CHM estimators, although PAI/FHD transfer remains region-dependent and benefits from local calibration. The framework also remains effective under temporal mismatch (winter LiDAR, summer RGBI), removing strict co-acquisition constraints and enabling scalable 20 cm operational monitoring for workflows such as Digital Twin Germany and national Digital Orthophoto programs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

13 of 43 references.

References · 13

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  6. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  7. 2020Knowledge Distillation: A Surveycited by 1,578
  8. 2024Depth Anything V2cited by 1,385
  9. 2022BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detectioncited by 66
  10. 2023Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidarcited by 60
  11. 2024CrossFuse: A Novel Cross Attention Mechanism based Infrared and Visible Image Fusion Approachcited by 38
  12. 2024Depth Any Canopy: Leveraging Depth Foundation Models for Canopy Height Estimationcited by 12
1 more
  1. 2025ForestFormer3D: A Unified Framework for End-to-End Segmentation of Forest LiDAR 3D Point Cloudscited by 12

Built on by

Not cited yet.