mlsanityData to 14 Oct 2026

Multi-Scale ViT Inference with Habitat-Fit Priors and kNN Retrieval for Multi-Species Plant Identification

arXiv 2607.14509 ↗First posted 16 Jul 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper describes DS@GT ARC's third-place solution to the PlantCLEF 2026 challenge on multi-species plant identification in vegetation quadrat images, where systems must predict every species present in high-resolution (~3000 x 3000 pixel) plot photographs while training only on single-label images of individual plants. The pipeline is built around a fine-tuned DINOv2 ViT-L/14 classifier applied over a multi-scale tile decomposition of each quadrat, with per-tile predictions blended with a FAISS kNN retriever and post-processed by source-aware temporal fusion across repeated plot visits, a habitat-fit demotion that injects geographic and altitude priors from the training data, and a South-Western Europe geographic mask. Habitat-fit demotion and multi-scale aggregation are the largest individual contributors in the ablations. Two complementary training-centric directions, a cross-region transformer with noisy-student distillation on the LUCAS dataset and a label-as-query transformer decoder over synthetic CLS-domain pseudo-quadrats, yielded null results. An inference-time augmentation with instance-aware segmentation crops also did not improve performance. The selected submission reaches a private-leaderboard macro-F1 of 0.43902 (third place; public 0.51096); an unselected configuration of the same pipeline scored above 0.45 on the private set. Code: https://github.com/dsgt-arc/plantclef-2026.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

15 of 24 references.

References · 15

  1. 2023Segment Anythingcited by 8,234
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2025SAM 3: Segment Anything with Conceptscited by 906
  4. 2023Vision Transformers Need Registerscited by 871
  5. 2020Asymmetric Loss For Multi-Label Classificationcited by 381
  6. 2018Data Augmentation using Random Image Cropping and Patching for Deep CNNscited by 88
  7. 2021ML-Decoder: Scalable and Versatile Classification Headcited by 79
  8. 2024Multi-Label Plant Species Classification with Self-Supervised Vision Transformerscited by 7
  9. 2025Overview of PlantCLEF 2024: multi-species plant identification in vegetation plot imagescited by 6
  10. 2025Overview of PlantCLEF 2025: Multi-Species Plant Identification in Vegetation Quadrat Imagescited by 6
  11. 2025Overview of PlantCLEF 2023: Image-based Plant Identification at Global Scalecited by 3
  12. 2025Tile-Based ViT Inference with Visual-Cluster Priors for Zero-Shot Multi-Species Plant Identificationcited by 2
3 more
  1. 2025Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformerscited by 2
  2. 2025Overview of PlantCLEF 2022: Image-based plant identification at global scalecited by 2
  3. 2025Plant identification based on noisy web data: the amazing performance of deep learning (LifeCLEF 2017)cited by 1

Built on by

Not cited yet.