mlsanityData to 14 Oct 2026

TerraNova: A Foundation Model for the Anthropocene

arXiv 2607.29527 ↗First posted 31 Jul 2026cs.LG cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

A defining problem of the Anthropocene is to model the physical Earth and human societies as one coupled system, yet no learned representation spans their observational breadth. We argue the obstacle is geometric: the physical Earth is measured as continuous fields that ignore political borders, whereas societies are reported for administrative units. Earth-system foundation models serve the first geometry; coupling it to the second has required lossy averaging over borders. We introduce TerraNova, a foundation model trained on 1,024 physical and societal records in their native geometries: 512 gridded Earth-system fields and 512 national indicators. Dedicated encoders represent location, country, time and task, cross-modal transformers fuse them into a shared spatiotemporal state, and a hypernetwork generates a per-query decoder whose evidential head returns a predictive distribution. Two contrastive objectives couple the representation: a population-weighted alignment between each country and coordinates in its territory, and one to pretrained geospatial embeddings carrying image-derived semantics. Read out through that decoder, the representation is competitive with purpose-built geospatial encoders while spanning axes they do not represent (time, oceans and uncertainty) and supporting country-level capabilities. The frozen backbone reconstructs dense fields from sparse observations and adapts to unseen variables in minutes on consumer hardware.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 77 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

34 of 77 references.

References · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  6. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  9. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  10. 2016HyperNetworkscited by 1,027
  11. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  12. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
22 more
  1. 2019Deep Evidential Regressioncited by 355
  2. 2023ClimaX: A foundation model for weather and climatecited by 337
  3. 2023VeRA: Vector-based Random Matrix Adaptationcited by 300
  4. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
  5. 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
  6. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
  7. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
  8. 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 137
  9. 2020Participation is not a Design Fix for Machine Learningcited by 111
  10. 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 104
  11. 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 101
  12. 2023Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networkscited by 61
  13. 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 53
  14. 2019Word Embeddings: A Surveycited by 45
  15. 2022The Unreasonable Effectiveness of Deep Evidential Regressioncited by 40
  16. 2025RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddingscited by 19
  17. 2024General Geospatial Inference with a Population Dynamics Foundation Modelcited by 18
  18. 2025Measuring the Intrinsic Dimension of Earth Representationscited by 10
  19. 2024MiSS: Revisiting the Trade-off in LoRA with an Efficient Shard-Sharing Structurecited by 7
  20. 2023NeuBTF: Neural fields for BTF encoding and transfercited by 5
  21. 2025Neural Conditional Transport Mapscited by 2
  22. 2026A harmonised dataset for Earth system foundation modelscited by 2

Built on by

Not cited yet.