GeoSANE: Learning Geospatial Representations from Models, Not Data
Not on the map. Why?
Abstract (arXiv)
Recent advances in remote sensing have led to an increase in the number of available foundation models; each trained on different modalities, datasets, and objectives, yet capturing only part of the vast geospatial knowledge landscape. While these models show strong results within their respective domains, their capabilities remain complementary rather than unified. Therefore, instead of choosing one model over another, we aim to combine their strengths into a single shared representation. We introduce GeoSANE, a geospatial model foundry that learns a unified neural representation from the weights of existing foundation models and task-specific models, able to generate novel neural networks weights on-demand. Given a target architecture, GeoSANE generates weights ready for finetuning for classification, segmentation, and detection tasks across multiple modalities. Models generated by GeoSANE consistently outperform their counterparts trained from scratch, match or surpass state-of-the-art remote sensing foundation models, and outperform models obtained through pruning or knowledge distillation when generating lightweight networks. Evaluations across ten diverse datasets and on GEO-Bench confirm its strong generalization capabilities. By shifting from pre-training to weight generation, GeoSANE introduces a new framework for unifying and transferring geospatial knowledge across models and tasks. Code is available at hrefhttps://hsg-aiml.github.io/GeoSANE/hsg-aiml.github.io/GeoSANE/.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 62 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
44 of 62 references.
References · 44
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2016HyperNetworkscited by 1,003
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2021Robust fine-tuning of zero-shot modelscited by 785
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
32 more
- 2017Functional Map of the Worldcited by 338
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
- 2017Variational Dropout Sparsifies Deep Neural Networkscited by 265
- 2019BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understandingcited by 231
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 202
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 178
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 122
- 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
- 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
- 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 97
- 2022Learning to Learn with Generative Models of Neural Network Checkpointscited by 85
- 2021TorchGeo: Deep Learning With Geospatial Datacited by 73
- 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 73
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 66
- 2022Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weightscited by 63
- 2023FLAIR: a Country-Scale Land Cover Semantic Segmentation Dataset From Multi-Source Optical Imagerycited by 41
- 2025Galileo: Learning Global & Local Features of Many Remote Sensing Modalitiescited by 41
- 2024Towards Scalable and Versatile Weight Space Learningcited by 40
- 2022Model Zoos: A Dataset of Diverse Populations of Neural Network Modelscited by 38
- 2024Diffusion-Based Neural Network Weights Generationcited by 38
- 2025We Should Chart an Atlas of All the World's Modelscited by 25
- 2025TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observationcited by 25
- 2026A Survey of Weight Space Learning: Understanding, Representation, and Generationcited by 15
- 2021Hyper-Representations: Self-Supervised Representation Learning on Neural Network Weights for Model Characteristic Predictioncited by 9
- 2025Learning Model Representations Using Publicly Available Model Hubscited by 4
- 2025A Model Zoo of Vision Transformerscited by 3
- 2025A Model Zoo on Phase Transitions in Neural Networkscited by 3
- 2025Know Your Attention Maps: Class-specific Token Masking for Weakly Supervised Semantic Segmentationcited by 3
- 2025MAPEX: Modality-Aware Pruning of Experts for Remote Sensing Foundation Modelscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.