mlsanityData to 14 Oct 2026

Multi-Year Geospatial Reasoning using Interannually-Consistent Historical Predictions as a Free Input Modality

arXiv 2608.05979 ↗First posted 6 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine learning, and deep networks in particular, are increasingly used to derive higher-level Earth observation (EO) products such as annual land-cover and crop-type maps. Many are generated operationally: each year a new acquisition is processed, typically with the same model, extending a multi-year archive. In the process these systems accumulate two kinds of useful signal that are almost never fed back into the model: the system's own archive of past predictions, and ancillary layers produced by other partners in a processing consortium. Both are normally used outside the network, as rule-based post-processing or a fixed input mask. Using the Copernicus Land Monitoring Service High Resolution Layer (HRL) Croplands crop-type product as a testbed, we show that bringing both signals inside the model turns a single-year, single-task pixel classifier into one that reasons across years. We introduce a Crop Type (CTY) embedding encoder that represents each past prediction as a confidence-scaled, time-ordered categorical token and attends over the year axis, and we study how the externally provided Base Vegetation Layer (BVL) mask should be represented in the model's inputs and outputs. To compare designs fairly when they relabel non-crop pixels, we evaluate on the 18 crop classes only and report precision and recall separately. On a pan-European dataset of about 5.4M labelled pixels, adding the prediction history raises crop-only F1 by 1.6 percentage points (pp) and, more importantly, corrects a recall-skewed error profile, with the largest gains on perennial and tree crops (olives +4.6, fruits +3.7, nuts +3.2 pp). Representing the BVL mask consistently in both the history and the target year adds about 2.5 pp on the crop classes. The approach is a low-cost recipe for any recurring geospatial or foundation model that emits class maps.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

19 of 31 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
  4. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  5. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  6. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 149
  7. 2021Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networkscited by 143
  8. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 103
  9. 2016Entity Embeddings of Categorical Variablescited by 87
  10. 2018Temporal Convolutional Neural Network for the Classification of Satellite Image Time Seriescited by 76
  11. 2019Self-attention for raw optical Satellite Time Series Classificationcited by 75
  12. 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
7 more
  1. 2020Lightweight Temporal Self-Attention for Classifying Satellite Image Time Seriescited by 55
  2. 2019BreizhCrops: A Time Series Dataset for Crop Type Mappingcited by 34
  3. 2025TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observationcited by 25
  4. 2021EuroCrops: A Pan-European Dataset for Time Series Crop Type Classificationcited by 13
  5. 2021From parcel to continental scale -- A first European crop type map based on Sentinel-1 and LUCAS Copernicus in-situ observationscited by 11
  6. 2025Deploying Geospatial Foundation Models in the Real World: Lessons from WorldCerealcited by 6
  7. 2021Crop Rotation Modeling for Deep Learning-Based Parcel Classification from Satellite Time Seriescited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physically Interpretable AlphaEarth Foundation Model Embeddings Enable LLM-Based Land Surface Intelligence
  2. 2026Temporal Sensitivity Analysis of Tessera Embeddings
  3. 2026GeoChrono: Benchmarking and Rethinking Long-Term Temporal Understanding in Remote Sensing
  4. 2024REO-VLM: Transforming VLM to Meet Regression Challenges in Earth Observation
  5. 2026GeoSANE: Learning Geospatial Representations from Models, Not Data
  6. 2026TESSERA v2: Scaling Pixel-wise Earth Foundation Models
  7. 2026Emerging Flexible Designs for Geospatial Multimodal Foundation Models
  8. 2025Towards Unified Vision Language Models for Forest Ecological Analysis in Earth Observation