mlsanityData to 14 Oct 2026

Spatioformer: A Geo-encoded Transformer for Large-Scale Plant Species Richness Prediction

arXiv 2410.19256 ↗First posted 25 Oct 2024cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Earth observation data have shown promise in predicting species richness of vascular plants (α-diversity), but extending this approach to large spatial scales is challenging because geographically distant regions may exhibit different compositions of plant species (β-diversity), resulting in a location-dependent relationship between richness and spectral measurements. In order to handle such geolocation dependency, we propose textitSpatioformer, where a novel geolocation encoder is coupled with the transformer model to encode geolocation context into remote sensing imagery. The Spatioformer model compares favourably to state-of-the-art models in richness predictions on a large-scale ground-truth richness dataset (HAVPlot) that consists of 68,170 in-situ richness samples covering diverse landscapes across Australia. The results demonstrate that geolocational information is advantageous in predicting species richness from satellite observations over large spatial scales. With Spatioformer, plant species richness maps over Australia are compiled from Landsat archive for the years from 2015 to 2023. The richness maps produced in this study reveal the spatiotemporal dynamics of plant species richness in Australia, providing supporting evidence to inform effective planning and policy development for plant diversity conservation. Regions of high richness prediction uncertainties are identified, highlighting the need for future in-situ surveys to be conducted in these areas to enhance the prediction accuracy.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 18 of its 76 references that are in the map. First posted on arXiv 25 Oct 2024.

Builds on

18 of 76 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  4. 2020Rethinking Positional Encoding in Language Pre-trainingcited by 197
  5. 2020Geography-Aware Self-Supervised Learningcited by 190
  6. 2021SpectralFormer: Rethinking Hyperspectral Image Classification with Transformerscited by 169
  7. 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
  8. 2022A high-resolution canopy height model of the Earthcited by 91
  9. 2020Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cellscited by 90
  10. 2023Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networkscited by 61
  11. 2021A Review of Location Encoding for GeoAI: Methods and Applicationscited by 54
  12. 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictionscited by 39
6 more
  1. 2015Improving Image Classification with Location Contextcited by 33
  2. 2021Positional Encoder Graph Neural Networks for Geographic Datacited by 20
  3. 2017Effective Sequential Classifier Training for SVM-based Multitemporal Remote Sensing Image Classificationcited by 10
  4. 2023FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pretrainingcited by 6
  5. 2023Plant species richness prediction from DESIS hyperspectral data: A comparison study on feature extraction procedures and regression modelscited by 5
  6. 2022Quantitative Assessment of DESIS Hyperspectral Data for Plant Biodiversity Estimation in Australiacited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.