mlsanityData to 7 Oct 2026

MOMO: Mars Orbital Model Foundation Model for Mars Orbital Applications

arXiv 2604.02719 ↗First posted 3 Apr 2026cs.CV cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce MOMO, the first multi-sensor foundation model for Mars remote sensing. MOMO uses model merge to integrate representations learned independently from three key Martian sensors (HiRISE, CTX, and THEMIS), spanning resolutions from 0.25 m/pixel to 100 m/pixel. Central to our method is our novel Equal Validation Loss (EVL) strategy, which aligns checkpoints across sensors based on validation loss similarity before fusion via task arithmetic. This ensures models are merged at compatible convergence stages, leading to improved stability and generalization. We train MOMO on a large-scale, high-quality corpus of ~ 12 million samples curated from Mars orbital data and evaluate it on 9 downstream tasks from Mars-Bench. MOMO achieves better overall performance compared to ImageNet pre-trained, earth observation foundation model, sensor-specific pre-training, and fully-supervised baselines. Particularly on segmentation tasks, MOMO shows consistent and significant performance improvement. Our results demonstrate that model merging through an optimal checkpoint selection strategy provides an effective approach for building foundation models for multi-resolution data. The model weights, pretraining code, pretraining data, and evaluation code are available at: https://github.com/kerner-lab/MOMO.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 51 of its 76 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

51 of 76 references.

References · 51

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2014Going Deeper with Convolutionscited by 4,231
  5. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  6. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  7. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  8. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  9. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
  10. 2022Editing Models with Task Arithmeticcited by 1,076
  11. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  12. 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 585
38 more
  1. 2021Fast Model Editing at Scalecited by 491
  2. 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 460
  3. 2022Memory-Based Model Editing at Scalecited by 443
  4. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  5. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
  6. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 250
  7. 2021Training Neural Networks with Fixed Sparse Maskscited by 212
  8. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 202
  9. 2022Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Modelscited by 187
  10. 2022Patching open-vocabulary models by interpolating weightscited by 187
  11. 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
  12. 2023ZipIt! Merging Models from Different Tasks without Trainingcited by 178
  13. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
  14. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
  15. 2020Hyperparameter Ensembles for Robustness and Uncertainty Quantificationcited by 149
  16. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148
  17. 2024Task Singular Vectors: Reducing Task Interference in Model Mergingcited by 143
  18. 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
  19. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 102
  20. 2020Model Patching: Closing the Subgroup Performance Gap with Data Augmentationcited by 82
  21. 2024Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagerycited by 82
  22. 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 76
  23. 2020Understanding SSIMcited by 75
  24. 2021Editing a classifier by rewriting its prediction rulescited by 64
  25. 2024Vision Foundation Models in Remote Sensing: A Surveycited by 52
  26. 2024Bridging Remote Sensors with Multisensor Geospatial Foundation Modelscited by 46
  27. 2024SpectralEarth: Training Hyperspectral Foundation Models at Scalecited by 42
  28. 2022Fixing Model Bugs with Natural Language Patchescited by 32
  29. 2022Stochastic Weight Averaging Revisitedcited by 26
  30. 2024Application-Driven Innovation in Machine Learningcited by 24
  31. 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 18
  32. 2025Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusioncited by 16
  33. 2025Generalized Linear Mode Connectivity for Transformerscited by 14
  34. 2021Mars Image Content Classification: Three Years of NASA Deployment and Recent Advancescited by 10
  35. 2025How Does the Spatial Distribution of Pre-training Data Affect Geospatial Foundation Models?cited by 5
  36. 2025SSL4Eco: A Global Seasonal Dataset for Geospatial Foundation Models in Ecologycited by 5
  37. 2025Deploying Geospatial Foundation Models in the Real World: Lessons from WorldCerealcited by 5
  38. 2025Mars-Bench: A Benchmark for Evaluating Foundation Models for Mars Science Taskscited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.