Mini-JEPA Foundation Model Fleet Enables Agentic Hydrologic Intelligence
Not on the map. Why?
Abstract (arXiv)
Geospatial foundation models compress multispectral observations into dense embeddings increasingly used in natural-language environmental reasoning systems. A single planetary-scale model, e.g. Google AlphaEarth, handles broad characterization well but may compromise on specialized hydrologic signals. Such generalist models are also often inaccessible, expensive, and require large-scale compute. We propose Mini-JEPAs: a fleet of small sensor-specialized Joint Embedding Predictive Architecture (JEPA) foundation models consulted by a routing agent for specialized questions. We pretrained five 22M-parameter Mini-JEPAs sharing an identical Vision Transformer backbone, JEPA recipe, and 64-d output space, using Sentinel-2 optical, Sentinel-1 SAR, MODIS thermal, multi-temporal Sentinel-2 phenology, and a topography-soil stack. Each Mini-JEPA reconstructs the variable matched to its sensor, with cross-validated R2 reaching 0.97 for elevation, 0.97 for temperature, and 0.81 for precipitation. The five manifolds differ in geometric structure, with global participation ratios from 8.9 to 20.2 and local intrinsic dimensionalities from 2.3 to 9.0. Joint topography-soil and phenology models add predictive value beyond AlphaEarth alone for soil moisture, aridity, and precipitation (Delta R2 up to 0.031). A router LLM reads per-modality references and selects appropriate sensors with a perfect hit rate over a curated question set. In paired LLM-as-Judge evaluation, dual retrieval over AlphaEarth and the routed fleet outperforms AlphaEarth alone on physics-matched questions (Cohen's d = 1.10, p = 0.031). Locally-trained Mini-JEPAs can be operationalized for hydrologic intelligence with modest compute.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
12 of 31 references.
References · 12
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 149
- 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 137
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
- 2026Physically Interpretable AlphaEarth Foundation Model Embeddings Enable LLM-Based Land Surface Intelligencecited by 6
- 2026Characterizing AlphaEarth Embedding Geometry for Agentic Environmental Reasoningcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025AQUAH: Automatic Quantification and Unified Agent in Hydrology
- 2026GeoSANE: Learning Geospatial Representations from Models, Not Data
- 2025GAIA: A Foundation Model for Operational Atmospheric Dynamics
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions
- 2026Agentic AI in Remote Sensing: Foundations, Taxonomy, and Emerging Systems
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data
- 2026The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery