SegmentAnyTreeV2: Scaling Transformer-Based Tree Instance Segmentation Across Sensors, Platforms, and Forests
Not on the map. Why?
Abstract (arXiv)
We present SegmentAnyTreeV2, a sensor- and platform-agnostic framework for semantic and instance segmentation of forest point clouds. The model combines a serialization-based Point Transformer v3 backbone with a lightweight semantic head and a tree-focused cross-attention mask decoder. Semantic predictions restrict instance decoding to tree-class voxels, while instance-aware query initialization, one-to-many seed supervision, and asymmetric mask scoring improve separation in dense and structurally complex stands. We further introduce FOR-instance v3, an expanded benchmark comprising 427 scenes and 26,496 annotated trees across diverse biomes, forest structures, and LiDAR platforms. On the FOR-instanceV2 test split, SegmentAnyTreeV2 achieves 90.5% precision, 80.2% recall, 85.0% F1, 90.7% coverage, and 87.6% semantic mIoU, outperforming previous learning-based methods in both instance detection and mask completeness. Zero-shot evaluation on independent sites further demonstrates strong cross-domain generalization.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 83 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
35 of 83 references.
References · 35
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
- 2020OccuSeg: Occupancy-aware 3D Instance Segmentationcited by 177
23 more
- 2017SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentationcited by 169
- 2019Learning Object Bounding Boxes for 3D Instance Segmentation on Point Cloudscited by 156
- 2018GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloudcited by 146
- 20203D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentationcited by 141
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 127
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
- 2019Associatively Segmenting Instances and Semantics in Point Cloudscited by 86
- 2019JSIS3D: Joint Semantic-Instance Segmentation of 3D Point Clouds with Multi-Task Pointwise Networks and Multi-Value Conditional Random Fieldscited by 62
- 2023Top-Down Beats Bottom-Up in 3D Instance Segmentationcited by 31
- 2022MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentationcited by 30
- 2019MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentationcited by 25
- 2023Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representationcited by 24
- 2023FOR-instance: a UAV laser scanning benchmark dataset for semantic and instance segmentation of individual treescited by 21
- 20193D-BEVIS: Bird's-Eye-View Instance Segmentationcited by 17
- 2024SegmentAnyTree: A sensor and platform agnostic deep learning model for tree segmentation using laser scanning datacited by 17
- 20223D-QueryIS: A Query-based Framework for 3D Instance Segmentationcited by 14
- 2023Point2Tree(P2T) -- framework for parameter tuning of semantic and instance segmentation used with mobile laser scanning data in coniferous forestcited by 14
- 2025Relation3D: Enhancing Relation Modeling for Point Cloud Instance Segmentationcited by 11
- 2023Towards accurate instance segmentation in large-scale LiDAR point cloudscited by 8
- 2023Semantic segmentation of sparse irregular point clouds for leaf/wood discriminationcited by 6
- 20243D-AVS: LiDAR-based 3D Auto-Vocabulary Segmentationcited by 5
- 2026ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentationcited by 4
- 2025Scaling Up Forest Vision with Synthetic Datacited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.