mlsanityData to 14 Oct 2026

TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observation

arXiv 2506.06281 ↗First posted 6 Jun 2025cs.CVcited by 25

Not on the map. Why?

Abstract (arXiv)

Modern Earth observation (EO) increasingly leverages deep learning to harness the scale and diversity of satellite imagery across sensors and regions. While recent foundation models have demonstrated promising generalization across EO tasks, many remain limited by the scale, geographical coverage, and spectral diversity of their training data, factors critical for learning globally transferable representations. In this work, we introduce TerraFM, a scalable self-supervised learning model that leverages globally distributed Sentinel-1 and Sentinel-2 imagery, combined with large spatial tiles and land-cover aware sampling to enrich spatial and semantic coverage. By treating sensing modalities as natural augmentations in our self-supervised approach, we unify radar and optical inputs via modality-specific patch embeddings and adaptive cross-attention fusion. Our training strategy integrates local-global contrastive learning and introduces a dual-centering mechanism that incorporates class-frequency-aware regularization to address long-tailed distributions in land cover.TerraFM achieves strong generalization on both classification and segmentation tasks, outperforming prior models on GEO-Bench and Copernicus-Bench. Our code and pretrained models are publicly available at: https://github.com/mbzuai-oryx/TerraFM .

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 24 of its 36 references that are in the map. First posted on arXiv 6 Jun 2025.

Builds on

24 of 36 references.

References · 24

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  6. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  7. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  8. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  9. 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
  10. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  11. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  12. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
12 more
  1. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
  2. 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
  3. 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 53
  4. 2024Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensingcited by 47
  5. 2022On Data Scaling in Masked Image Modelingcited by 46
  6. 2024Bridging Remote Sensors with Multisensor Geospatial Foundation Modelscited by 46
  7. 2021Next Day Wildfire Spread: A Machine Learning Data Set to Predict Wildfire Spreading from Remote-Sensing Datacited by 42
  8. 2023Decoupling Common and Unique Representations for Multimodal Self-supervised Learningcited by 36
  9. 2025Panopticon: Advancing Any-Sensor Foundation Models for Earth Observationcited by 34
  10. 2024Major TOM: Expandable Datasets for Earth Observationcited by 32
  11. 2023Better, Not Just More: Data-Centric Machine Learning for Earth Observationcited by 19
  12. 2024Fus-MAE: A cross-attention-based data fusion approach for Masked Autoencoders in remote sensingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 22.

25 papers.

Sort:

By area:

  1. 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agentscited by 15
  2. 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 12
  3. 2026EarthShift: a benchmark for measuring robustness to real-world distribution shifts in Earth observationcited by 11
  4. 2026PRUE: A Practical Recipe for Field Boundary Segmentation at Scalecited by 5
  5. 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observationcited by 5
  6. 2025GeoCrossBench: Cross-Band Generalization for Remote Sensingcited by 4
  7. 2026Any Model, Any Place, Any Time: Get Remote Sensing Foundation Model Embeddings On Demandcited by 4
  8. 2026A Unified Foundation Model for All-in-One Multi-Modal Remote Sensing Image Restoration and Fusion with Language Promptingcited by 3
  9. 2025MAESTRO: Masked AutoEncoders for Multimodal, Multitemporal, and Multispectral Earth Observation Datacited by 2
  10. 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observationcited by 2
  11. 2026GeoSANE: Learning Geospatial Representations from Models, Not Datacited by 2
  12. 2026GeoMeld: Toward Semantically Grounded Foundation Models for Remote Sensingcited by 2
13 more
  1. 2026SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretrainingcited by 2
  2. 2026SLED: Scalable Location Encoding via Distillationcited by 2
  3. 2025Assessing the value of Geo-Foundational Models for Flood Inundation Mapping: Benchmarking models for Sentinel-1, Sentinel-2, and Planetscope for end-userscited by 1
  4. 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Datacited by 1
  5. 2026Spatial Representation Learning Beyond Pixels: Unifying Raster Data and Vector Semantics for Human-Centric Geospatial Foundation Modelscited by 1
  6. 2026Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shiftscited by 1
  7. 2026Neural Processes Maintain Calibrated Biomass Estimates Across Spatiotemporal Gaps and Disturbancecited by 0
  8. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?cited by 0
  9. 2026Multi-Year Geospatial Reasoning using Interannually-Consistent Historical Predictions as a Free Input Modalitycited by 0
  10. 2026Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inferencecited by 0
  11. 2026AlignJEPA: Predictive Vision-Language Alignment for Remote Sensing Foundation Modelscited by 0
  12. 2026Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understandingcited by 0
  13. 2026Autoregressive Drillhole Modelling Under Distribution Shiftcited by 0