Verifiably grounded machine interpretation of lunar geology
Not on the map. Why?
Abstract (arXiv)
Planetary geology relies on historical, interpretive reasoning to reconstruct past events from diverse observations. Here, we investigate how far this interpretive workflow can be automated by a multimodal vision-language model. Focusing on the stratigraphy of lunar basaltic mare volcanism, we train a model to generate verifiably grounded geologic interpretations directly from co-registered topographic, spectral, and geologic maps. We demonstrate that while the system successfully balances established geological priors with local visual evidence to accurately describe stratigraphy and terrain, numeric age dating derived solely from vision defaults to memorized priors. Integrating an open-book retrieval mechanism resolves this, enabling the model to faithfully cite published chronologies. Our findings delineate the necessary architecture for automated geologic inference: site evidence must be visually interpreted from local data, while quantitative historical context must be retrieved from the scientific record.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 91 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
39 of 91 references.
References · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Visual Instruction Tuningcited by 7,869
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
27 more
- 2020GLU Variants Improve Transformercited by 1,804
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 661
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2019Is Attention Interpretable?cited by 389
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 20234M: Massively Multimodal Masked Modelingcited by 120
- 2021An Image is Worth 16x16 Words, What is a Video Worth?cited by 87
- 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
- 2021Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformerscited by 72
- 2018ROUGE 2.0: Updated and Improved Measures for Evaluation of Summarization Taskscited by 67
- 20244M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalitiescited by 52
- 2021Perceptual Score: What Data Modalities Does Your Model Perceive?cited by 35
- 2025The Moon's Many Faces: A Single Unified Transformer for Multimodal Lunar Reconstructioncited by 3
- 2026Vision-Language Model for Accurate Crater Detectioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Geo-Strat-RL: Learning Geological Event Reasoning from Verifiable Tasks
- 2026LLaVA-LE: Large Language-and-Vision Assistant for Lunar Exploration
- 2024Mitigating Interpretation Bias in Rock Records with Large Language Models: Insights from Paleoenvironmental Analysis
- 2026LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretation
- 2025Mars-Bench: A Benchmark for Evaluating Foundation Models for Mars Science Tasks
- 2025Synthetic Geology: Structural Geology Meets Deep Learning
- 2023Knowledge distillation with Segment Anything (SAM) model for Planetary Geological Mapping
- 2026MarsRetrieval: Benchmarking Vision-Language Models for Planetary-Scale Geospatial Retrieval on Mars