mlsanityData to 7 Oct 2026

Global and Dense Embeddings of Earth: Major TOM Floating in the Latent Space

arXiv 2412.05600 ↗First posted 7 Dec 2024cs.CV cs.DBcited by 12

Not on the map. Why?

Abstract (arXiv)

With the ever-increasing volumes of the Earth observation data present in the archives of large programmes such as Copernicus, there is a growing need for efficient vector representations of the underlying raw data. The approach of extracting feature representations from pretrained deep neural networks is a powerful approach that can provide semantic abstractions of the input data. However, the way this is done for imagery archives containing geospatial data has not yet been defined. In this work, an extension is proposed to an existing community project, Major TOM, focused on the provision and standardization of open and free AI-ready datasets for Earth observation. Furthermore, four global and dense embedding datasets are released openly and for free along with the publication of this manuscript, resulting in the most comprehensive global open dataset of geospatial visual embeddings in terms of covered Earth's surface.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 7 Dec 2024.

Builds on

18 of 32 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  5. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  6. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
  7. 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 214
  8. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
  9. 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
  10. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
  11. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 102
  12. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 76
6 more
  1. 2021TorchGeo: Deep Learning With Geospatial Datacited by 73
  2. 2023Decoupling Common and Unique Representations for Multimodal Self-supervised Learningcited by 36
  3. 2024Major TOM: Expandable Datasets for Earth Observationcited by 31
  4. 2023From LAION-5B to LAION-EO: Filtering Billions of Images Using Anchor Datasets for Satellite Image Extractioncited by 14
  5. 2022Embedding Earth: Self-supervised contrastive pre-training for dense land cover classificationcited by 6
  6. 2015Multiple Measurements and Joint Dimensionality Reduction for Large Scale Image Search with Short Vectors - Extended Versioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 9.

12 papers.