mlsanityData to 14 Oct 2026

Multimodal-Multiresolution Foundation Model for Lunar Remote Sensing

arXiv 2609.13283 ↗First posted 8 Sep 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a multimodal foundation model for lunar remote sensing, pretrained from scratch on SomBench, a geographically partitioned corpus of nearly two million co-registered tile bundles spanning 11 modalities at two spatial scales (1 m/pixel and 100 m/pixel). The model adapts the TerraMind masked-token architecture with two lunar-specific extensions: acquisition geometry is provided as explicit context, and meter- and hundred-meter-scale tiles are trained jointly so that a single set of weights covers both resolutions. FlexiViT patch embeddings allow adaptation to different patch sizes without retraining, while modality-wise inputs enable flexible multimodal fine-tuning. Qualitative generation experiments suggest the model learns meaningful cross-modal correspondences, including terrain derivatives from elevation and illumination-consistent reflectance from geometry. We evaluate on four benchmarks: crater detection at WAC and NAC scales, irregular mare patch (IMP) segmentation, and polar ice prospectivity regression. Across tasks, the pretrained model matches or outperforms ImageNet-pretrained baselines and an architecturally identical random-init control. On multimodal ice prospectivity regression, pretrained variants achieve the best results, while the random-init model outperforms most baselines, suggesting gains arise from both the architecture and pretraining. Label efficiency is notable for WAC crater detection, where the pretrained model trained on 50% of the data exceeds the strongest ImageNet baseline trained on the full dataset. Among adaptation strategies, LoRA matches or surpasses full fine-tuning on crater detection and IMP segmentation while using far fewer trainable parameters, whereas full fine-tuning performs best for ice prospectivity regression. We release the pretrained checkpoint, benchmark datasets, and fine-tuning code to support reproducible lunar AI research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 53 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

23 of 53 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2022A ConvNet for the 2020scited by 3,579
  5. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  6. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  8. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  9. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  10. 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 576
  11. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  12. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
11 more
  1. 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 291
  2. 2022DaViT: Dual Attention Vision Transformerscited by 175
  3. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  4. 2022FlexiViT: One Model for All Patch Sizescited by 152
  5. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 149
  6. 20234M: Massively Multimodal Masked Modelingcited by 120
  7. 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 104
  8. 2023Feature Guided Masked Autoencoder for Self-supervised Learning in Remote Sensingcited by 48
  9. 2025TerraTorch: The Geospatial Foundation Models Toolkitcited by 25
  10. 2025The Moon's Many Faces: A Single Unified Transformer for Multimodal Lunar Reconstructioncited by 3
  11. 2026LunarFM: A Shared Multimodal Representation of the Moon's Surfacecited by 1

Built on by

Not cited yet.