mlsanityData to 14 Oct 2026

SSL4Eco: A Global Seasonal Dataset for Geospatial Foundation Models in Ecology

arXiv 2504.18256 ↗First posted 25 Apr 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

With the exacerbation of the biodiversity and climate crises, macroecological pursuits such as global biodiversity mapping become more urgent. Remote sensing offers a wealth of Earth observation data for ecological studies, but the scarcity of labeled datasets remains a major challenge. Recently, self-supervised learning has enabled learning representations from unlabeled data, triggering the development of pretrained geospatial models with generalizable features. However, these models are often trained on datasets biased toward areas of high human activity, leaving entire ecological regions underrepresented. Additionally, while some datasets attempt to address seasonality through multi-date imagery, they typically follow calendar seasons rather than local phenological cycles. To better capture vegetation seasonality at a global scale, we propose a simple phenology-informed sampling strategy and introduce corresponding SSL4Eco, a multi-date Sentinel-2 dataset, on which we train an existing model with a season-contrastive objective. We compare representations learned from SSL4Eco against other datasets on diverse ecological downstream tasks and demonstrate that our straightforward sampling method consistently improves representation quality, highlighting the importance of dataset construction. The model pretrained on SSL4Eco reaches state of the art performance on 7 out of 8 downstream tasks spanning (multi-label) classification and regression. We release our code, data, and model weights to support macroecological and computer vision research at https://github.com/PlekhanovaElena/ssl4eco.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 46 of its 102 references that are in the map. First posted on arXiv 25 Apr 2025.

Builds on

46 of 102 references.

References · 46

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  9. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  11. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
  12. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
34 more
  1. 2021Scaling Vision Transformerscited by 999
  2. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  3. 2017Functional Map of the Worldcited by 338
  4. 2019BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understandingcited by 234
  5. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  6. 2020Geography-Aware Self-Supervised Learningcited by 190
  7. 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
  8. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  9. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  10. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
  11. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 149
  12. 2021Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networkscited by 143
  13. 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
  14. 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
  15. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 103
  16. 2019SEN12MS -- A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusioncited by 95
  17. 2022A high-resolution canopy height model of the Earthcited by 91
  18. 2022SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observationcited by 84
  19. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
  20. 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
  21. 2024OmniSat: Self-Supervised Modality Fusion for Earth Observationcited by 63
  22. 2023Spatial Implicit Neural Representations for Global-Scale Species Mappingcited by 59
  23. 2021SustainBench: Benchmarks for Monitoring the Sustainable Development Goals with Machine Learningcited by 54
  24. 2023FLAIR: a Country-Scale Land Cover Semantic Segmentation Dataset From Multi-Source Optical Imagerycited by 41
  25. 2024Major TOM: Expandable Datasets for Earth Observationcited by 32
  26. 2024Large Language Models for Captioning and Retrieving Remote Sensing Imagescited by 30
  27. 2024PhilEO Bench: Evaluating Geo-Spatial Foundation Modelscited by 25
  28. 2024ChatEarthNet: A Global-Scale Image-Text Dataset Empowering Vision-Language Geo-Foundation Modelscited by 24
  29. 2023Better, Not Just More: Data-Centric Machine Learning for Earth Observationcited by 19
  30. 2024AGBD: A Global-scale Biomass Datasetcited by 13
  31. 2024WildSAT: Learning Satellite Image Representations from Wildlife Observationscited by 13
  32. 2024Planted: a dataset for planted forest identification from multi-satellite time seriescited by 9
  33. 2025How Does the Spatial Distribution of Pre-training Data Affect Geospatial Foundation Models?cited by 5
  34. 2025GSR4B: Biomass Map Super-Resolution with Sentinel-1/2 Guidancecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.