Transferability and operational reliability of a Prithvi crop classification foundation model under phenological and geographic shift across three continents
Not on the map. Why?
Abstract (arXiv)
Fine-tuned geospatial foundation models (GeoFMs) pretrained on large satellite archives have been shown to improve crop classification accuracy and geographic transferability. However, their operational performance beyond the training distribution remains poorly characterized. We evaluated the out-of-distribution performance of a widely adopted GeoFM [Prithvi-EO-2.0] across 37 events in 12 countries on three continents and validated against regional reference products. Results indicated that the mean overall accuracy (OA) declined from 0.65 in the United States to 0.40 in Europe. Beyond accuracy metrics, we assessed five key aspects of model performance: whether model confidence indicates signal failure, sensitivity to observation windows, the effect of coarsening class schemes, and robustness to both band loss and cloud- and shadow-contamination. Accuracy collapsed when the observation window misaligned with local crop phenology, while deterministic confidence remained high. Expected calibration error increased for seven of eight paired events, and 12-51% of each affected scene was confidently mislabeled at near-zero precision. Monte Carlo dropout entropy registered the shift in all eight, indicating that much of the apparent cross-continent decline reflected phenological misalignment rather than spatial transfer. Two adjustments recovered accuracy without retraining. Consolidating 13 classes into 10, based on the model's dominant confusions, raised the mean OA by 8.4 percentage points. Compressing the window toward near-real-time use preserved accuracy across a 45- to 90-day plateau, peaking near 75 days, though arms tighter than 30 days fell about 0.11 below that plateau. Fine-tuned crop GeoFMs therefore transfer usefully only where observation windows match local growing seasons. We translate these findings into operational guidance for the reliable deployment of the released model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 45 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
20 of 45 references.
References · 20
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 149
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
- 2025TerraTorch: The Geospatial Foundation Models Toolkitcited by 25
- 2021TimeMatch: Unsupervised Cross-Region Adaptation by Temporal Shift Estimationcited by 21
- 2022A Sentinel-2 multi-year, multi-country benchmark dataset for crop classification and segmentation with deep learningcited by 19
- 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 12
- 2021From parcel to continental scale -- A first European crop type map based on Sentinel-1 and LUCAS Copernicus in-situ observationscited by 11
- 2025AgriFM: A Multi-source Temporal Remote Sensing Foundation Model for Agriculture Mappingcited by 9
8 more
- 2025Deploying Geospatial Foundation Models in the Real World: Lessons from WorldCerealcited by 6
- 2024On the Generalizability of Foundation Models for Crop Type Mappingcited by 5
- 2025SHRUG-FM: Reliability-Aware Foundation Models for Earth Observationcited by 3
- 2022Towards Global Crop Maps with Transfer Learningcited by 2
- 2025From Time-series Generation, Model Selection to Transfer Learning: A Comparative Review of Pixel-wise Approaches for Large-scale Crop Mappingcited by 1
- 2025FARM: Fine-Tuning Geospatial Foundation Models for Intra-Field Crop Yield Regressioncited by 1
- 2026Do Foundation Model Embeddings Improve Cross-Country Crop Yield Generalisation? A Leave-One-Country-Out Evaluation in Sub-Saharan Africacited by 1
- 2026Land cover and flood type govern the detection limits of satellite-based flood mapping across diverse global flood eventscited by 1
Built on by
Not cited yet.