mlsanityData to 7 Oct 2026

Physically Typed and Geometry-Aware Representations for Earth Foundation Models

arXiv 2609.13868 ↗First posted 12 Sep 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Earth-observation (EO) foundation models have become exceptionally effective at learning se mantic, high-dimensional geospatial embeddings, while modern weather and climate models have demonstrated that Earth-specific geometry, spherical operators, meshes, and hybrid physical solvers can materially improve prediction. Yet these two advances are not equivalent. A conventional latent embedding has no inherent physical transformation law, whereas scalar fields, tangent polar-vector fields, axial/pseudovector quantities, covectors, and higher-order tensors transform differently under rotations, reflections, and changes of local coordinate frame. This proposal asks whether a general purpose Earth foundation model should preserve those distinctions explicitly, or whether standard embeddings plus augmentation already learn everything that matters. The central contribution is therefore not a more complicated architecture by assumption, but a staged falsification program. A compute-conscious ERA5 dry run first compares conventional, augmentation-matched, typed equivariant, and Hodge/Helmholtz variants under spatial, temporal, orientation, and low-data shifts. Only if explicit geometric typing yields reproducible improvements does the program advance toward a multimodal Earth foundation model in which semantic embeddings coexist with physically typed fields. The proposed gap is narrower and more defensible than claiming that current models ignore geometry entirely: several systems already respect spherical domain geometry, and emerging work explicitly learns scalar/vector fields on spheres. The unresolved question is whether foundation-scale, multimodal, parity-aware field typing produces practical gains beyond those existing approaches.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

22 of 45 references.

References · 22

  1. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  2. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  3. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  4. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  5. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  6. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  7. 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 262
  8. 2023Neural General Circulation Models for Weather and Climatecited by 232
  9. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
  10. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
  11. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
  12. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
10 more
  1. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
  2. 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 122
  3. 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
  4. 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 97
  5. 2025Galileo: Learning Global & Local Features of Many Remote Sensing Modalitiescited by 41
  6. 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observationcited by 20
  7. 2026TESSERA v2: Scaling Pixel-wise Earth Foundation Modelscited by 3
  8. 2026SwissCrop25: A National Multi-Year Benchmark for Operational Crop Mappingcited by 3
  9. 2024HDNet: Physics-Inspired Neural Network for Flow Estimation based on Helmholtz Decompositioncited by 2
  10. 2025SO(3)-Equivariant Neural Networks for Learning from Scalar and Vector Fields on Spherescited by 2

Built on by

Not cited yet.