Physically Typed and Geometry-Aware Representations for Earth Foundation Models
Not on the map. Why?
Abstract (arXiv)
Earth-observation (EO) foundation models have become exceptionally effective at learning se mantic, high-dimensional geospatial embeddings, while modern weather and climate models have demonstrated that Earth-specific geometry, spherical operators, meshes, and hybrid physical solvers can materially improve prediction. Yet these two advances are not equivalent. A conventional latent embedding has no inherent physical transformation law, whereas scalar fields, tangent polar-vector fields, axial/pseudovector quantities, covectors, and higher-order tensors transform differently under rotations, reflections, and changes of local coordinate frame. This proposal asks whether a general purpose Earth foundation model should preserve those distinctions explicitly, or whether standard embeddings plus augmentation already learn everything that matters. The central contribution is therefore not a more complicated architecture by assumption, but a staged falsification program. A compute-conscious ERA5 dry run first compares conventional, augmentation-matched, typed equivariant, and Hodge/Helmholtz variants under spatial, temporal, orientation, and low-data shifts. Only if explicit geometric typing yields reproducible improvements does the program advance toward a multimodal Earth foundation model in which semantic embeddings coexist with physically typed fields. The proposed gap is narrower and more defensible than claiming that current models ignore geometry entirely: several systems already respect spherical domain geometry, and emerging work explicitly learns scalar/vector fields on spheres. The unresolved question is whether foundation-scale, multimodal, parity-aware field typing produces practical gains beyond those existing approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
22 of 45 references.
References · 22
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 262
- 2023Neural General Circulation Models for Weather and Climatecited by 232
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
10 more
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
- 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 122
- 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
- 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 97
- 2025Galileo: Learning Global & Local Features of Many Remote Sensing Modalitiescited by 41
- 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observationcited by 20
- 2026TESSERA v2: Scaling Pixel-wise Earth Foundation Modelscited by 3
- 2026SwissCrop25: A National Multi-Year Benchmark for Operational Crop Mappingcited by 3
- 2024HDNet: Physics-Inspired Neural Network for Flow Estimation based on Helmholtz Decompositioncited by 2
- 2025SO(3)-Equivariant Neural Networks for Learning from Scalar and Vector Fields on Spherescited by 2
Built on by
Not cited yet.