mlsanityData to 14 Oct 2026

Verifiably grounded machine interpretation of lunar geology

arXiv 2608.09276 ↗First posted 10 Aug 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Planetary geology relies on historical, interpretive reasoning to reconstruct past events from diverse observations. Here, we investigate how far this interpretive workflow can be automated by a multimodal vision-language model. Focusing on the stratigraphy of lunar basaltic mare volcanism, we train a model to generate verifiably grounded geologic interpretations directly from co-registered topographic, spectral, and geologic maps. We demonstrate that while the system successfully balances established geological priors with local visual evidence to accurately describe stratigraphy and terrain, numeric age dating derived solely from vision defaults to memorized priors. Integrating an open-book retrieval mechanism resolves this, enabling the model to faithfully cite published chronologies. Our findings delineate the necessary architecture for automated geologic inference: site evidence must be visually interpreted from local data, while quantitative historical context must be retrieved from the scientific record.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 91 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

39 of 91 references.

References · 39

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  8. 2017Neural Discrete Representation Learningcited by 4,712
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  11. 2017Billion-scale similarity search with GPUscited by 2,497
  12. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
27 more
  1. 2020GLU Variants Improve Transformercited by 1,804
  2. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  3. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  4. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  5. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  7. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
  8. 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 661
  9. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  10. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  11. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  12. 2019Is Attention Interpretable?cited by 389
  13. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  14. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  15. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  16. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
  17. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
  18. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
  19. 20234M: Massively Multimodal Masked Modelingcited by 120
  20. 2021An Image is Worth 16x16 Words, What is a Video Worth?cited by 87
  21. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
  22. 2021Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformerscited by 72
  23. 2018ROUGE 2.0: Updated and Improved Measures for Evaluation of Summarization Taskscited by 67
  24. 20244M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalitiescited by 52
  25. 2021Perceptual Score: What Data Modalities Does Your Model Perceive?cited by 35
  26. 2025The Moon's Many Faces: A Single Unified Transformer for Multimodal Lunar Reconstructioncited by 3
  27. 2026Vision-Language Model for Accurate Crater Detectioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Geo-Strat-RL: Learning Geological Event Reasoning from Verifiable Tasks
  2. 2026LLaVA-LE: Large Language-and-Vision Assistant for Lunar Exploration
  3. 2024Mitigating Interpretation Bias in Rock Records with Large Language Models: Insights from Paleoenvironmental Analysis
  4. 2026LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretation
  5. 2025Mars-Bench: A Benchmark for Evaluating Foundation Models for Mars Science Tasks
  6. 2025Synthetic Geology: Structural Geology Meets Deep Learning
  7. 2023Knowledge distillation with Segment Anything (SAM) model for Planetary Geological Mapping
  8. 2026MarsRetrieval: Benchmarking Vision-Language Models for Planetary-Scale Geospatial Retrieval on Mars