SelectAnyTree: A Promptable Instance Segmentation Model for 3D Forest LiDAR Point Clouds
Not on the map. Why?
Abstract (arXiv)
Instance segmentation of trees in forest LiDAR point clouds is constrained by label scarcity: A single hectare holds millions of points and hundreds of overlapping tree crowns, making manual annotation laborious, while automatic pre-segmentations offer no interactive refinement. Inspired by the promptable paradigm of foundation segmentation models, we propose SelectAnyTree, which delineates any individual tree in a 3D forest point cloud from a few clicks and is purpose-built for promptable instance segmentation of 3D forest LiDAR scenes. The proposed SelectAnyTree couples three lightweight stages: (1) Sparse voxel scene encoder that embeds the forest once into reusable features, (2) Click-to-query prompt encoder that turns each click into a single content query from its 3D position, positive/negative polarity, and the backbone feature of its nearest voxel, and (3) State-space query decoder that converts this query into one tree mask with linear-time complexity, with a mask feedback that conditions each refinement round on the previous mask. Each additional tree therefore costs only a lightweight prompt-encoding and decoding pass, and the full model requires just 19.4 M parameters, far fewer than prior promptable 3D models. Additionally, we exploit forest-aware information by detecting treetops as local maxima of the Canopy Height Model (CHM) computed from the scene geometry, and associating one with the user's click as a free initial click. Across seven diverse forest regions and an independent held-out dataset, SelectAnyTree segments a target tree to 79.9 Intersection-over-Union (IoU) from a single click, 24.7 points above the strongest promptable baseline, and reaches every accuracy target with the fewest clicks. The source code is available at https://github.com/thanhhff/SelectAnyTree.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
27 of 41 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2020Point Transformercited by 1,470
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
15 more
- 2024VMamba: Visual State Space Modelcited by 969
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
- 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 50
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentationcited by 33
- 2023Automated forest inventory: analysis of high-density airborne LiDAR point clouds with 3D deep learningcited by 23
- 2025PartSAM: A Scalable Promptable Part Segmentation Model Trained on Native 3D Datacited by 16
- 2023TreeLearn: A deep learning method for segmenting individual trees from ground-based LiDAR forest point cloudscited by 14
- 2023Test-Time Augmentation for 3D Point Cloud Classification and Segmentationcited by 4
- 2026ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentationcited by 4
- 2026LaSSM: Efficient Semantic-Spatial Query Decoding via Local Aggregation and State Space Models for 3D Instance Segmentationcited by 3
- 2026SegmentAnyTreeV2: Scaling Transformer-Based Tree Instance Segmentation Across Sensors, Platforms, and Forestscited by 3
- 2025Probabilistic Interactive 3D Segmentation with Hierarchical Neural Processescited by 2
Built on by
Not cited yet.