mlsanityData to 14 Oct 2026

TESSERA: Temporal Embeddings of Surface Spectra for Earth Representation and Analysis

arXiv 2506.20380 ↗First posted 25 Jun 2025cs.LGcited by 39

Not on the map. Why?

Abstract (arXiv)

Satellite Earth-observation (EO) time series in the optical and microwave ranges of the electromagnetic spectrum are often irregular due to orbital patterns and cloud obstruction. Compositing addresses these issues but loses information with respect to vegetation phenology, which is critical for many downstream tasks. Instead, we present TESSERA, a pixel-wise foundation model for multi-modal (Sentinel-1/2) EO time series that learns robust, label-efficient embeddings. During model training, TESSERA uses Barlow Twins and sparse random temporal sampling to enforce invariance to the selection of valid observations. We employ two key regularizers: global shuffling to decorrelate spatial neighborhoods and mix-based regulation to improve invariance under extreme sparsity. We find that for diverse classification, segmentation, and regression tasks, TESSERA embeddings deliver state-of-the-art accuracy with high label efficiency, often requiring only a small task head and minimal computation. To democratize access, adhere to FAIR - principles, and simplify use, we release global, annual, 10m, pixel-wise int8 embeddings together with open weights/code and lightweight adaptation heads, thus providing practical tooling for large-scale retrieval and inference at planetary scale. All code and data are available at: https://github.com/ucam-eo/tessera.

Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 99 of its 233 references that are in the map. First posted on arXiv 25 Jun 2025.

Builds on

99 of 233 references.

References · 99

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  8. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  9. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  10. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  11. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  12. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
38 more
  1. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  2. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
  3. 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
  4. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  5. 2020Geography-Aware Self-Supervised Learningcited by 190
  6. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
  7. 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
  8. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  9. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  10. 2022RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rankcited by 153
  11. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 151
  12. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
  13. 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
  14. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
  15. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
  16. 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
  17. 2022An Empirical Study of Remote Sensing Pretrainingcited by 105
  18. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 104
  19. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 103
  20. 2022A high-resolution canopy height model of the Earthcited by 91
  21. 2020A Generalizable and Accessible Approach to Machine Learning with Global Satellite Imagerycited by 88
  22. 2022SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observationcited by 84
  23. 2024Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagerycited by 83
  24. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
  25. 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
  26. 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
  27. 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 69
  28. 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
  29. 2024OmniSat: Self-Supervised Modality Fusion for Earth Observationcited by 63
  30. 2023A Billion-scale Foundation Model for Remote Sensing Imagescited by 62
  31. 2023Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidarcited by 60
  32. 2021Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Codingcited by 58
  33. 2020Lightweight Temporal Self-Attention for Classifying Satellite Image Time Seriescited by 55
  34. 2021Self-Supervised Material and Texture Representation Learning for Remote Sensing Taskscited by 49
  35. 2023CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understandingcited by 48
  36. 2023Feature Guided Masked Autoencoder for Self-supervised Learning in Remote Sensingcited by 48
  37. 2024Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensingcited by 47
  38. 2023Predicting Gradient is Better: Exploring Self-Supervised Learning for SAR ATR with a Joint-Embedding Predictive Architecturecited by 46

50 most cited of 99 All 99 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 32.

39 papers.

Sort:

By area:

  1. 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observationcited by 24
  2. 2025Cropland Mapping using Geospatial Embeddingscited by 5
  3. 2026Earth Embeddings as Products: Taxonomy, Ecosystem, and Standardized Accesscited by 5
  4. 2026CITYREP: A Unified Benchmark for Urban Representations Across Cities, Tasks, and Modalitiescited by 5
  5. 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observationcited by 5
  6. 2026TESSERA v2: Scaling Pixel-wise Earth Foundation Modelscited by 5
  7. 2026Inferring Height from Earth Embeddings: First insights using Google AlphaEarthcited by 4
  8. 2026Any Model, Any Place, Any Time: Get Remote Sensing Foundation Model Embeddings On Demandcited by 4
  9. 2025SHRUG-FM: Reliability-Aware Foundation Models for Earth Observationcited by 3
  10. 2026Location Is All You Need: Continuous Spatiotemporal Neural Representations of Earth Observation Datacited by 2
  11. 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directionscited by 2
  12. 2025Assessing the Effectiveness of Deep Embeddings for Tree Species Classification in the Dutch Forest Inventorycited by 1
27 more
  1. 2025Grazing Detection using Deep Learning and Sentinel-2 Time Series Datacited by 1
  2. 2026Structure-Semantic Decoupled Modulation of Global Geospatial Embeddings for High-Resolution Remote Sensing Mappingcited by 1
  3. 2026Better Together: Evaluating the Complementarity of Earth Embedding Modelscited by 1
  4. 2026Exploring the potential of AlphaEarth and TESSERA embeddings for Fine-scale Local Climate Zone Mapping: A case study across five cities in Switzerlandcited by 1
  5. 2026From Machine Learning to Large-Scale EO Products: Best Practices for Making Mapscited by 1
  6. 2026GEOID-Flood: A Large-Scale Multi-Modal Benchmark Dataset for Flood Segmentationcited by 1
  7. 2026Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shiftscited by 1
  8. 2025Geospatial Machine Learning Librariescited by 0
  9. 2025Context-Aware Multimodal Representation Learning for Spatio-Temporally Explicit Environmental Modellingcited by 0
  10. 2026Neural Processes Maintain Calibrated Biomass Estimates Across Spatiotemporal Gaps and Disturbancecited by 0
  11. 2026FLUXtrapolation: A benchmark on extrapolating ecosystem fluxescited by 0
  12. 2026Biomazon: A Multimodal Dataset for 3D Forest Structure and Biomass Modeling in the Amazon Basincited by 0
  13. 2026Urban Heat MiniCubes: An AI-Ready dataset for urban heat researchcited by 0
  14. 2026Is sub-metre resolution necessary for cocoa mapping? A landscape-stratified evaluation of very high resolution imagery, decametric Earth Observation inputs, and operational products in Cote d'Ivoirecited by 0
  15. 2026Now We Know? A Systematic Comparison of TerraMind and THORcited by 0
  16. 2026Earth Embeddingscited by 0
  17. 2026Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zonecited by 0
  18. 2026Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inferencecited by 0
  19. 2026Temporal Sensitivity Analysis of Tessera Embeddingscited by 0
  20. 2026A Machine Learning API for Earth Observation Data Cubes Based on openEOcited by 0
  21. 2026SPEAR NeXT Causal Latent Forecasting Across Multiple Horizons for Spectral Temporal Earth Representation Learningcited by 0
  22. 2026Annual Earth-observation embeddings encode wildfire disturbance and support simplified burned area mappingcited by 0
  23. 2026Recoverable Geographic Location Information in Earth-Observation Embeddingscited by 0
  24. 2026AlphaEarth distinguishes cities but compresses urban variationcited by 0
  25. 2026Reuse or Relearn? A Spectral View of Earth Observation Foundation Modelscited by 0
  26. 2026When local gains fail to transfer: Frozen Earth-observation embeddings across wildfirescited by 0
  27. 2026Planetary Feature Fields are Scalable Earth Representationscited by 0