mlsanityData to 14 Oct 2026

THOR: A Versatile Foundation Model for Earth Observation Climate and Society Applications

arXiv 2601.16011 ↗First posted 22 Jan 2026eess.IV cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Current Earth observation foundation models are architecturally rigid, struggle with heterogeneous sensors and are constrained to fixed patch sizes. This limits their deployment in real-world scenarios requiring flexible computeaccuracy trade-offs. We propose THOR, a "computeadaptive" foundation model that solves both input heterogeneity and deployment rigidity. THOR is the first architecture to unify data from Copernicus Sentinel-1, -2, and -3 (OLCI & SLSTR) satellites, processing their native 10 m to 1000 m resolutions in a single model. We pre-train THOR with a novel randomized patch and input image size strategy. This allows a single set of pre-trained weights to be deployed at inference with any patch size, enabling a dynamic trade-off between computational cost and feature resolution without retraining. We pre-train THOR on THOR Pretrain, a new, large-scale multi-sensor dataset and demonstrate state-of-the-art performance on downstream benchmarks, particularly in data-limited regimes like the PANGAEA 10% split, validating that THOR's flexible feature generation excels for diverse climate and society applications.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

21 of 37 references.

References · 21

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  4. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  5. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  6. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  7. 2022FlexiViT: One Model for All Patch Sizescited by 152
  8. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
  9. 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
  10. 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 104
  11. 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 77
  12. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
9 more
  1. 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
  2. 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
  3. 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 53
  4. 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
  5. 2023USat: A Unified Self-Supervised Encoder for Multi-Sensor Satellite Imagerycited by 28
  6. 2024Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretrainingcited by 28
  7. 2025FlexiMo: A Flexible Remote Sensing Foundation Modelcited by 24
  8. 2023Domain-specific optimization and diverse evaluation of self-supervised models for histopathologycited by 11
  9. 2024On Pretraining Data Diversity for Self-Supervised Learningcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.