MOMO: Mars Orbital Model Foundation Model for Mars Orbital Applications
Not on the map. Why?
Abstract (arXiv)
We introduce MOMO, the first multi-sensor foundation model for Mars remote sensing. MOMO uses model merge to integrate representations learned independently from three key Martian sensors (HiRISE, CTX, and THEMIS), spanning resolutions from 0.25 m/pixel to 100 m/pixel. Central to our method is our novel Equal Validation Loss (EVL) strategy, which aligns checkpoints across sensors based on validation loss similarity before fusion via task arithmetic. This ensures models are merged at compatible convergence stages, leading to improved stability and generalization. We train MOMO on a large-scale, high-quality corpus of ~ 12 million samples curated from Mars orbital data and evaluate it on 9 downstream tasks from Mars-Bench. MOMO achieves better overall performance compared to ImageNet pre-trained, earth observation foundation model, sensor-specific pre-training, and fully-supervised baselines. Particularly on segmentation tasks, MOMO shows consistent and significant performance improvement. Our results demonstrate that model merging through an optimal checkpoint selection strategy provides an effective approach for building foundation models for multi-resolution data. The model weights, pretraining code, pretraining data, and evaluation code are available at: https://github.com/kerner-lab/MOMO.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 51 of its 76 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
51 of 76 references.
References · 51
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2014Going Deeper with Convolutionscited by 4,231
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2022Editing Models with Task Arithmeticcited by 1,076
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
- 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 585
38 more
- 2021Fast Model Editing at Scalecited by 491
- 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 460
- 2022Memory-Based Model Editing at Scalecited by 443
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 250
- 2021Training Neural Networks with Fixed Sparse Maskscited by 212
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 202
- 2022Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Modelscited by 187
- 2022Patching open-vocabulary models by interpolating weightscited by 187
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
- 2023ZipIt! Merging Models from Different Tasks without Trainingcited by 178
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
- 2020Hyperparameter Ensembles for Robustness and Uncertainty Quantificationcited by 149
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148
- 2024Task Singular Vectors: Reducing Task Interference in Model Mergingcited by 143
- 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
- 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 102
- 2020Model Patching: Closing the Subgroup Performance Gap with Data Augmentationcited by 82
- 2024Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagerycited by 82
- 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 76
- 2020Understanding SSIMcited by 75
- 2021Editing a classifier by rewriting its prediction rulescited by 64
- 2024Vision Foundation Models in Remote Sensing: A Surveycited by 52
- 2024Bridging Remote Sensors with Multisensor Geospatial Foundation Modelscited by 46
- 2024SpectralEarth: Training Hyperspectral Foundation Models at Scalecited by 42
- 2022Fixing Model Bugs with Natural Language Patchescited by 32
- 2022Stochastic Weight Averaging Revisitedcited by 26
- 2024Application-Driven Innovation in Machine Learningcited by 24
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 18
- 2025Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusioncited by 16
- 2025Generalized Linear Mode Connectivity for Transformerscited by 14
- 2021Mars Image Content Classification: Three Years of NASA Deployment and Recent Advancescited by 10
- 2025How Does the Spatial Distribution of Pre-training Data Affect Geospatial Foundation Models?cited by 5
- 2025SSL4Eco: A Global Seasonal Dataset for Geospatial Foundation Models in Ecologycited by 5
- 2025Deploying Geospatial Foundation Models in the Real World: Lessons from WorldCerealcited by 5
- 2025Mars-Bench: A Benchmark for Evaluating Foundation Models for Mars Science Taskscited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.