Now We Know? A Systematic Comparison of TerraMind and THOR
Not on the map. Why?
Abstract (arXiv)
Benchmarks for Geospatial Foundation Models (GFMs) increasingly rank models by aggregate score, but such rankings obscure why models differ: how much of the gap is architecture, how much is decoder capacity, and how much is a use-case-specific artefact? This study addresses that gap through a controlled comparison of two GFMs developed under European Space Agency's Phi-lab with contrasting design philosophies: THOR, which introduces a compute-adaptive architecture supporting variable patch sizes and unifies Sentinel-1, -2, and -3 data at their native resolutions; and TerraMind, a multimodal generative GFM pretrained with a dual-scale token/pixel objective that enables any-to-any cross-modal generation (Thinking-in-Modalities) to infer missing sensors at inference time. Rather than reporting a single leaderboard, we investigate the axes along which the two architectures actually differ - patch size, decoder complexity, finetuning regime, input modality, and model scale - across ten use cases spanning segmentation and regression in diverse domains, including climate disaster response, methane leak detection, snow monitoring, or sea ice mapping. We find that architectural design choices - patch size and decoder type in particular - explain more performance variance than model identity itself, that the two models embody complementary investment strategies (pretraining-time scale for TerraMind versus inference-time tokenisation for THOR), and that correctly interpreting results requires dataset-level characterisation. The resulting picture is not a single winner but a set of hypotheses and a diagnostic ablation methodology that we expect to generalise to future GFMs beyond THOR and TerraMind.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
36 of 49 references.
References · 36
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
- 2022FlexiViT: One Model for All Patch Sizescited by 151
24 more
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 122
- 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 122
- 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
- 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 76
- 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 73
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Modelcited by 72
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 62
- 2025TESSERA: Temporal Embeddings of Surface Spectra for Earth Representation and Analysiscited by 35
- 2023FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoringcited by 30
- 2025Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And Morecited by 28
- 2025TerraTorch: The Geospatial Foundation Models Toolkitcited by 24
- 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observationcited by 20
- 2025GEO-Bench-2: From Performance to Capability, Rethinking Evaluation in Geospatial AIcited by 19
- 2025TerraMesh: A Planetary Mosaic of Multimodal Earth Observation Datacited by 14
- 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?cited by 10
- 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 9
- 2026EarthShift: a benchmark for measuring robustness to real-world distribution shifts in Earth observationcited by 8
- 2026THOR: A Versatile Foundation Model for Earth Observation Climate and Society Applicationscited by 6
- 2026MMEarth-Bench: Global Model Adaptation via Multimodal Test-Time Trainingcited by 4
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Datacited by 1
Built on by
Not cited yet.