mlsanityData to 14 Oct 2026

Toward a foundation model for forest point clouds

arXiv 2609.24787 ↗First posted 21 Sep 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Forest inventories increasingly rely on artificial intelligence (AI) models to derive forest attributes from large-scale 3D point clouds. Current models are typically specialized to a single task, sensor, and forest type, making adaptation expensive in terms of annotations, computation, and expertise. We ask whether a single pretrained model can instead learn transferable representations across diverse forest inventory settings. Inspired by recent developments in language modelling and computer vision, we take a step toward a foundation model (FM) for 3D forestry. Using LitePT as backbone, we first establish a strong supervised baseline that sets a new state of the art on forest semantic and instance segmentation, tree species classification, and age regression benchmarks. We then curate a large-scale unlabelled corpus spanning airborne, UAV, and mobile laser scanning across diverse forest ecosystems, and pretrain the same backbone using self-supervised learning. We systematically evaluate representation learning strategies by comparing training from scratch, supervised pretraining, and self-supervised pretraining across four representative forestry tasks, under varying annotation budgets. Compared with training from scratch, self-supervised pretraining accelerates model convergence and consistently improves performance when annotations are scarce. Compared with task-specific supervised pretraining, self-supervised pretraining yields more transferable representations across downstream forestry tasks. These findings identify the practical regime in which pretrained representations are most valuable and suggest that instance discrimination, rather than forest semantics, is the main remaining obstacle to a general-purpose 3D forest foundation model. Code and models are available at: https://github.com/prs-eth/ForPT.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 72 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

42 of 72 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2023Segment Anythingcited by 8,234
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  8. 2016Layer Normalizationcited by 5,669
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  11. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
  12. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
30 more
  1. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
  2. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  3. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
  4. 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 137
  5. 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 110
  6. 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 104
  7. 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
  8. 2022A high-resolution canopy height model of the Earthcited by 91
  9. 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
  10. 2023Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidarcited by 60
  11. 2023Efficient 3D Semantic Segmentation with Superpoint Transformercited by 57
  12. 2023FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoringcited by 31
  13. 2023Automated forest inventory: analysis of high-density airborne LiDAR point clouds with 3D deep learningcited by 23
  14. 2023FOR-instance: a UAV laser scanning benchmark dataset for semantic and instance segmentation of individual treescited by 21
  15. 2024SegmentAnyTree: A sensor and platform agnostic deep learning model for tree segmentation using laser scanning datacited by 17
  16. 2025LitePT: Lighter Yet Stronger Point Transformercited by 17
  17. 2024Open-Canopy: Towards Very High Resolution Forest Monitoringcited by 16
  18. 2023TreeLearn: A deep learning method for segmenting individual trees from ground-based LiDAR forest point cloudscited by 14
  19. 2025ForestFormer3D: A Unified Framework for End-to-End Segmentation of Forest LiDAR 3D Point Cloudscited by 13
  20. 2024Benchmarking tree species classification from proximally-sensed laser scanning data: introducing the FOR-species20K datasetcited by 12
  21. 2024PureForest: A Large-Scale Aerial Lidar and Aerial Imagery Dataset for Tree Species Classification in Monospecific Forestscited by 9
  22. 2025Bringing SAM to new heights: Leveraging elevation data for tree crown segmentation from drone imagerycited by 6
  23. 2025SSL4Eco: A Global Seasonal Dataset for Geospatial Foundation Models in Ecologycited by 5
  24. 2026SelvaMask: Segmenting Trees in Tropical Forests and Beyondcited by 5
  25. 2026Towards Foundation Models for 3D Scene Understanding: Instance-Aware Self-Supervised Learning for Point Cloudscited by 4
  26. 2026ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentationcited by 4
  27. 2025Scaling Up Forest Vision with Synthetic Datacited by 3
  28. 2026SegmentAnyTreeV2: Scaling Transformer-Based Tree Instance Segmentation Across Sensors, Platforms, and Forestscited by 3
  29. 2025EZ-SP: Fast and Lightweight Superpoint-Based 3D Segmentationcited by 2
  30. 2025Label-Efficient 3D Forest Mapping: Self-Supervised and Transfer Learning for Instance Segmentation, Semantic Segmentation, and Species Classificationcited by 1

Built on by

Not cited yet.