Latent Commonality Expectation-Maximisation for Box-supervised Tree Crown Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
Individual tree crown segmentation from aerial imagery underpins tree-level carbon accounting, biodiversity, and restoration monitoring at landscape scale. However, existing models are predominantly trained on dense canopy forest imagery and degrade in savannah and drylands, where tree crowns are sparse, of variable appearance, and underrepresented in annotated benchmarks. These models also typically depend on costly polygon annotations. We introduce LACE (LAtent Commonality Expectation-maximisation), a box-supervised instance segmentation model, evaluated on 0.1 m/px aerial RGB tree crown imagery. LACE uses a frozen DINOv3-web ViT-L/16 encoder, applied at four spatial offsets and interlaced into a denser feature grid, with a lightweight CenterNet-style detection head trained solely on bounding boxes. We use expectation-maximisation to separate recurring appearance, the "treeness", within bounding boxes from surroundings. On the OAM-TCD benchmark test set, LACE reaches a mask AP50 of 0.663 ± 0.001 (3 seeds) trained on 900 box-annotated images and without mask annotations, above the 0.626 scored by Restor's released mask-supervised Mask R-CNN, which was trained on the full ~4.2k image set. On a sparse-canopy holdout set, mask AP50 rises to 0.691 versus 0.612 for Detectree2, a mask-supervised baseline. On NeonTreeEvaluation, using the official evaluation code, LACE reaches 0.728 ± 0.003 [email protected] (5 seeds) from 23,424 hand-annotated RGB boxes alone, matching the authors' DeepForest model's published 0.719, using under 0.1% of its training annotations and none of its LiDAR-derived 30M-crown pretraining set. By leveraging frozen self-supervised features, LACE matches or surpasses fully-supervised specialist baselines from boxes alone, removing the need for polygon annotation in tree crown instance segmentation for sparse-canopy environments where labelled data is scarce.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 82 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
37 of 82 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Mask R-CNNcited by 7,259
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2015Fast R-CNNcited by 2,930
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
25 more
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2019Objects as Pointscited by 1,172
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
- 2022Unsupervised Semantic Segmentation by Distilling Feature Correspondencescited by 241
- 2015Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentationcited by 189
- 2018Cell Detection with Star-convex Polygonscited by 182
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
- 2020BoxInst: High-Performance Instance Segmentation with Box Annotationscited by 150
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022BoxTeacher: Exploring High-Quality Pseudo Labels for Weakly Supervised Instance Segmentationcited by 31
- 2022Box2Mask: Box-supervised Instance Segmentation via Level-set Evolutioncited by 22
- 2018Optimizing the Trade-off between Single-Stage and Two-Stage Object Detectors using Image Difficulty Predictioncited by 18
- 2024OAM-TCD: A globally diverse dataset of high-resolution tree cover mapscited by 14
- 2017Deep Descriptor Transforming for Image Co-Localizationcited by 6
- 2025Bringing SAM to new heights: Leveraging elevation data for tree crown segmentation from drone imagerycited by 6
- 2025SelvaBox: A high-resolution dataset for tropical tree crown detectioncited by 5
- 2026SelvaMask: Segmenting Trees in Tropical Forests and Beyondcited by 5
- 2024MP-PolarMask: A Faster and Finer Instance Segmentation for Concave Imagescited by 1
- 2026FG-TreeSeg: Flow-Guided Tree Crown Segmentation without Instance Annotationscited by 1
Built on by
Not cited yet.